OPTIMAL  AND  SUBOPTIMAL  FILTERING  FOR  TIME -INVARIANT 
SYSTEMS  EXCITED  BY  COMPOUND  POISSON  PROCESSES 


By 

ROBERT  MICHAEL  ROGERS 


A  DISSERTATION  PRESENTED  TO  THE  GRADUATE  COUNCIL 
OF  THE  UNIVERSITY  OF  FLORIDA  IN 
PARTIAL  FULFILLMENT  OF  THE  REQUIREMENTS 
FOR  THE  DEGREE  OF  DOCTOR  OF  PHILOSOPHY 


UNIVERSITY  OF  FLORIDA 
1983 


TABLE  OF  CONTENTS 


CHAPTER  PAGE 
LIST  OF  TABLES 

LIST  OF  FIGURES  ^ 

ABSTRACT  * 

ONE  INTRODUCTION   1 

Background   ^ 

Statement  of  the  Problem   3 

Review  of  Previous  Work   5 

Dissertation  Outline   8 

TWO  DEVELOPMENT  OF  OPTIMAL  FILTERING  EQUATIONS   10 

Introduction   10 

Conditional  Characteristic  Equation   10 

Differentiation  Rule   10 

Propagating  the  Conditional  Characteristic 

Function   ,   11 

Quasimoment  Filtering  Equations   12 

Quasimoment  Functions   12 

Filtering  Equations   13 

Summary   17 

THREE  PERFORMANCE  OF  THE  FILTERING  EQUATIONS   18 

Introduction   18 

Convergence  to  Linear  Filter  -  The  General  Case....  19 
Conditional  Characteristic  Equation  - 

Estimation  Error   20 

Solution  for  Continuous  Gaussian  Driving 

Noise   21 

Compound  Poisson  Process  J^proach  to  Gaussian.  23 

Linear  Filter  Performance   24 

Performance  of  the  Truncated  Non-linear  Filter   26 

Stability  of  the  Non -linear  Filtering 

Equations   27 

Re-examination  of  Convergence  to  Linear  Filter 

(Case  I:     X  -*  °°,  a     -  0,  Xa     =  constant)   35 


11 


Non -linear  Filter  Performance  Low 

Signal -to-Nbise   37 

,  2 
Xa  c 

(Case  II:  — - —  «  1  )   37 

a  r 

Non-linear  Filter  Performance  High 

Signal -to-Noise   39 

-  2 
Xa  c 

(Case  III:  — - —  »  1)   39 

a  r 

Summary   40 

FOUR                        NUMERICAL  EVALUATION   42 

Introduction   42 

Numerical  Algorithms   43 

Basis  of  Evaluation   44 

Discussion  of  Results   46 

Unconstrained  Second  Moment  Comparisons   48 

Constrained  Second  Moment  Comparisons   82 

Summary  of  Unconstrained  and  Constrained 

Examples   82 

Summary   103 

FIVE                         UNSTABLE  SYSTEM  FILTERING   104 

Introduction   104 

Truncated  Filtering  Eguation  Stability  and 

Performance-Unstable  Systems   105 

Numerical  Evaluation   109 

Summary   118 

SIX                          CONCLUSIONS  AND  RECOMMENDATIONS   120 

APPENDIX  A     QUASI-MOMENT  FUNCTIONS   122 

APPENDIX  B     DIFFERENTATION  RULE  AND  FILTERING  THEOREM   127 

APPENDIX  C     COMPUTER  PROGRAM  LISTINGS   131 

REFERENCES   142 

BIOGRAPHICAL  SKETCH   144 


ill 


LIST  OF  TABLES 


Table  Description  Page 

1  NON-LINEAR  FILTERING  EQUATIONS  UP  TO  THE  SIXTH 
QUASIMOMENT  IN  STATE  VECTOR  FORM  28 

2  REFORMULATED  NON-LINEAR  FILTERING  EQUATIONS 

FROM  TABLE  1  29 

3  SYSTEM  PARAMETERS  AND  STATIONARY  VALUES  FOR  THE 
NUMERICAL  EXAMPLES  SIMULATED  47 

4  SUMMARY  OF  UNCONSTRAINED  AND  CONSTRAINED  SECOND 

MOMENT  RESULTS  -  MEAN  SQUARED  ERROR  TIME  =  1 /X  95 


iv 


^1 


LIST  OF  FIGURES 


Figure  ■        Description  Page 

1  Eckberg  example,  Unconstrained,  One  sigma  jump  linear, 

4th  and  6th  quasimoment  filter  vs  state  '♦9 

2  Eckberg  example,  Unconstrained,  One  sigma  jump  mean 

squared  error  for  all  filters  50 

3  Eckberg  example,  Unconstrained,  One  sigma  jump  mean 

of  second  moment  for  non-linear  filters  51 

4  Eckberg  example,  Unconstrained,  One  sigma  jump 

variance  of  second  moment  for  non-linear  filters  52 

5  Eckberg  example.  Unconstrained,  Two  sigma  jump 

linear,  4th  and  6th  quasimoment  filter  vs  state  53 

6  Eckberg  example.  Unconstrained,  Two  sigma  jump  mean 

squared  error  for  all  filters  54 

7  Eckberg  example,  Unconstrained,  Two  sigma  jump  mean 

of  second  moment  for  non-linear  filters  55 

8  Eckberg  example.  Unconstrained,  Two  sigma  jump 

variance  of  second  moment  for  non-linear  filters  56 

9  Kwakernaak  example,  Unconstrained,  One  sigma  jump 

linear,  4th  and  6th  quasimoment  filter  vs  state  57 

10  Kwakernaak  example.  Unconstrained,  One  sigma  jump 

mean  squared  error  for  all  filters  58 

11  Kwakernaak  example,  Uncosntrained ,  One  sigma  jump 

mean  of  second  moment  for  non-linear  filters  59 

12  Kwakernaak  example,  Unconstrained,  One  sigma  jump 

variance  of  second  moment  for  non-linear  filters  60 

13  Kwakernaak  example,  Unconstrained,  Two  sigma  jump 

linear,  4th  and  6th  quasimoment  filter  vs  state  61 

14  Kwakernaak  example,  Unconstrained,  Two  sigma  jump 

mean  squared  error  for  all  filters  62 


V 


LIST  OF  FIGURES  (continued) 


Figure  Description  Page 

15  Kwakernaak  example,  Unconstrained,  Two  sigraa  Jump 

mean  of  second  moment  for  non-linear  filters  63 

16  Kwakernaak  example,  Unconstrained,  Two  sigma  jump 

variance  of  second  moment  for  non-linear  filters  6^1 

17  Example  3,  Unconstrained,  One  sigma  jump  linear, 

4th  and  6th  quasimoment  filter  vs  state  65 

18  Example  3,  Unconstrained,  One  sigma  jump  mean 

squared  error  all  filters  66 

19  Example  3,  Unconstrained,  One  sigma  jump  mean 

of  second  moment  for  non-linear  filters  67 

20  Example  3,  Unconstrained,  One  sigma  jump  variance 

of  second  moment  for  non-linear  filters  68 

21  Example  3,  Unconstrained,  Two  sigma  jump  linear, 

4th  and  5th  quasimoment  filter  vs  state  69 

22  Example  3,  Unconstrained,  Two  sigma  jump  mean 

squared  error  for  all  filters  70 

23  Example  3,  Unconstrained,  Two  sigma  jump  mean 

of  second  moment  for  non-linear  filters  71 

24  Example  3,  Unconstrained,  Two  sigma  jump  variance 

of  second  moment  for  non-linear  filters  72 

25  Example  4,  Unconstrained,  One  sigraa  jump  linear, 

4th  and  6th  quasimoment  filter  vs  state  73 

26  Example  4,  Unconstrained,  One  sigma  jump  mean 

squared  error  for  all  filters  7^ 

27  Example  4,  Unconstrained,  One  sigma  jump  mean 

of  second  moment  for  non-linear  filters  75 

28  Example  4,  Unconstrained,  One  sigraa  jump  variance 

of  second  raoment  for  non-linear  filters  76 

29  Example  4,  Unconstrained,  Two  sigraa  jump  linear, 

4th  and  6th  quasimoment  filter  vs  state  77 

30  Example  4,  Unconstrained,  Two  sigma  jump  mean 

squared  error  for  all  filters  78 


vi 


LIST  OF  FIGURES  (continued) 


Description 

Example  ^,  Unconstrained,  Two  sigma  jump  mean 
of  second  moment  for  non-linear  filters 

Example  4,  Unconstrained,  Two  sigma  jump  variance 
of  second  moment  for  non-linear  filters 

Kwakernaak  example.  Constrained,  One  sigma  jump 
linear,  4th  and  6th  quasimoment  filter  vs  state 

Kwakernaak  example.  Constrained,  One  sigma  jump 
mean  squared  error  for  all  filters 

Kwakernaak  example.  Constrained,  One  sigma  jump 
mean  of  second  moment  for  non-linear  filters 

Kwakernaak  example,  Constrained,  One  sigma  jump 
variance  of  second  moment  for  non-linear  filters 

Example  3,  Constrained,  One  sigma  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 

Example  3,  Constrained,  One  sigma  jump  mean 
squared  error    for  all  filters 

Example  3,  Constrained,  One  sigma  jump  mean  of 
second  moment  for  non-linear  filters 

Example  3,  Constrained,  One  sigma  jump  variance 
of  second  moment  for  non-linear  filters 

Example  3,  Constrained,  Two  sigma  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 

Example  3,  Constrained,  Two  sigma  jump  mean 
squared  error  for  all  filters 

Example  3,  Constrained,  Two  sigma  jump  mean 
of  second  moment  for  non-linear  filters 

Example  3,  Constrained,  Two  sigma  jump  variance 
of  second  moment  for  non-linear  filters 


vii 


LIST  OF  FIGURES  (continued) 


Figure  Description  Page 

45  Kwakernaak  example,  Constrained,  random  jump  amplitude 
and  occurrence  mean  squared  error  for  linear  and  4th 
quasimoment  filter  At=1.0E-4:     RSEED  1  .OE+3  97 

46  Kwakernaak  example.  Constrained,  random  jump  amplitude 
and-  occurrence  mean  of  second  moment  for  linear  and  4th 
quasimoment  filter  At=1.0E-4:     RSEED  1  .OE+3  98 


47  Kwakernaak  example.  Constrained,  random  jump  amplitude 

and  occurrence  mean  squared  error  for  linear  and  4th 
quasimoment  filter  At=1 .OE-4:     RSEED  1  .OE+7 


49  Kwakernaak  example,  Constrained,  random  jump  amplitude 
and  occurrence  mean  squared  error  for  linear  and  4th 
quasimoment  filter  At=1.0E-4:     RSEED  2. OE+7 

50  Kwakernaak  example.  Constrained,  random  jump  amplitude 
and  occurrence  mean  of  second  moment  for  linear  and  4th 
quasimoment  filter  At=1.0E-4:     RSEED  2. OE+7 

51  Redefined  Kwakernaak,  Constrained,  Qie  sigraa  jump  mean 
squared  error  for  linear  and  4th  quasimoment  filter, 
At=1 .OE-4 


99 


48  Kwakernaak  example.  Constrained,  random  jump  amplitude 

and  occurrence  mean  of  second  moment  for  linear  and  4th 
quasimoment  filter  At=1 .OE-4 :     RSEED  1  .OE+7  100 


101 


102 


110 


52  Redefined  Kwakernaak,  Constrained,  One  sigma  jump  mean 
of  second  moment  for  linear  and  4th  quasimoment  filter, 
At=1.0E-4  111 

53  Redefined  Kwakernaak,  Constrained,  Two  sigma  jump  mean 
squared  error  for  linear  and  4th  quasimoment  filter, 

At=1  .OE-4  112 

54  Redefined  Kwakernaak,  Constrained,  Two  sigma  jump  mean 
of  second  moment  for  linear  and  4th  quasimoment  filter, 

At=1 .OE-4  113 

55  Redefined  Kwakernaak,  Constrained,  random,  jump 
amplitude  and  occurrence  mean  squared  error  for  linear 

and  4th  quasimoment  filter,  At=1 .OE-4  114 

56  Redefined  Kwakernaak,  Constrained,  random,  jump 
amplitude  and  occurrence  mean  of  second  moment  for 

linear  and  4th  quasimoment  filter,   At=1 .OE-4  115 


viii 


-1 

LIST  OF  FIGURES  (continued ) 


gure  Description  Page 

57  Redefined,  Example  3,  Constrained,  random  jump 
amplitude  and  occurrence  mean  squared  error  for 

linear  and  4th  quasimoment  filter,  At=1 .OE-4  116 

58  Redefined,  Example  3,  Constrained,  random  jump 
amplitude  and  occurrence  mean  of  second  moment 

for  linear  and  4th  quasimoment  filter,  At=1  .OE-4  117 


ix 


1 


Abstract  of  Dissertation  Presented  to  the  Graduate  Council 
of  the  University  of  Florida  in  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of  Doctor  of  Philosophy 


OPTIMAL  AND  SUBOPTIMAL  FILTERING  FOR  TIME -INVARIANT 
SYSTEMS  EXCITED  BY  COMPOUND  POISSON  PROCESSES 

By 

Robert  Michael  Rogers 
December,  1983 

Chairman:     Dr.  William  H.  Boykin,  Jr. 
Major  Department:    Engineering  Sciences 

The  problem  addressed  in  this  research  is  the  estimation  of  a  linear 
time-invariant  scalar  system  excited  by  a  compound  Poisson  process  and 
observed  imperfectly  through  measurements  with  additive  continuous 
Gaussian  errors.     Previous  results  of  Eckberg,  Kwakernaak,  and  Au  for 
this  problem  have  been  inconclusive  or  inappropriately  concluded  in 
determining  that  a  linear  filter,  Kalman  or  Wiener,  performs  as  ade- 
quately as  a  truncated  optimal  infinite-dimensional  non-linear  filter. 
The  contribution  of  this  research  is  the  determination  conditions,  as 
specified  by  the  system  parameters,  under  which  the  linear  filter  performs 
as  adequately  as  the  truncated  non-linear  filter  and  conditions  under 
which  this  non-linear  filter  has  better  performance  than  the  linear 
filter. 

Specifically,  for  systems  characterized  by  high  signal-to-noise  ratios, 
improved  performance,  as  determined  by  the  mean  squared  error,  can  be 
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obtained  by  using  non-linear  filtering  equations.     Ihis  improved  per- 
formance can  be  achieved  by  implementing  a  constraint  of  the  positive 
semi-def initeness  of  the  second  moment  for  stable  systems  and  positive 
definiteness  for  unstable  systems.     The  filtering  equations  based  on 
a  fourth  quasimoment  truncation  with  the  second  moment  constraint 
exhibit  the  best  performance. 
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CHAPTER  ONE 
INTRODUCTION 

Background 

The  research  presented  in  this  dissertation  is  the  optimal  and 
suboptimal  filtering  of  continuous  linear  systems  driven  by  compound 
Poisson  white  noise  with  measurements  corrupted  by  additive  Gaussian 
white  noise.    Applications  using  stochastic  models  such  as  these  are 
found  in  many  fields.     The  specific  applications  of  interest  and  which 
motivated  this  research  are  those  found  in  the  aerospace  applications. 
These  will  be  discussed  following  the  review  of  other  applications. 

In  the  communications  field,  this  model  has  been  used  for  low- 
frequency  atmospheric  noise  (e.g.,  Eckberg,   1970,  and  Kwakernaak ,  1980). 
Environmental  problems  such  as  the  occasional  polluting  of  a  river  have 
also  been  modeled  by  this  type  stochastic  process  (e.g.,  Kwakernaak, 
1975).     Random  system  failures  in  the  field  of  system  reliability  also 
adapt  to  this  model  (e.g.,  Willsky  and  Jones,   1976,  and  Fiorina  and 
Maffezzoni,   1979).     Finally  by  analyzing  seismic  signals  oil  exploration 
is  conducted.    The  seismic  signals  are  represented  as  the  output  of  such 
a  model     (e.g.,  Mendel,   1977).     In  certain  of  these  applications,  post 
data  collection  processing  is  acceptable.     In  these  instances  optimal 
smoothing  rather  than  filtering  has  been  used  (e.g.,  Au ,   1979,  Au  and 
Haddad,   1978,  and  Au ,  Haddad  and  Poor,  1982). 

Optimal  estimation  via  filtering  is  the  desired  approach  since  the 
applications  of  interest  for  this  research  require  real  time  application 
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of  control  for  corrective  action.    An  application  for  this  filtering 
approach  is  the  state  estimation  of  tracked  randomly  maneuvering  targets. 
Randomly  maneuvering  target  acceleration  has  been  modeled  as  a  random 
telegraph  wave  process  (e.g.,  Price  and  Warren,  1973,  Zarchan,  1979, 
and  Rogers,  1982).    Modeled  as  a  random  telegraph  wave,  the  target 
acceleration- is  a  maximum  effort  fixed  level  which  alternates  in  direc- 
tion and  the  level  is  achieved  instantaneously.    In  these  papers,  this 
process  is  realized  as  a  first  order  continuous  Gaussian  process  for 
implementation  into  a  conventional  Kalman  filter.     Other  models  which 
include  varying  amplitudes,  response  time  and  time  duration  may  be  more 
appropriate.     These  models  would  be  determined  with  system  impulse 
response  characteristics  tailored  to  the  maneuvering  target's  charac- 
teristics   and  have  the  random  time  switching  characteristics. 

An  alternate  approach  to  target  modeling  and  estimation  has  been 
used  in  which  the  target  maneuvers  randomly  in  time  and  at  random  ampli- 
tudes (a  compound  Poisson  process)  with  the  amplitude  levels  limited  to 
discrete  levels  and  number  of  levels  (e.g.,  Moose,   1975,  Gholson  and 
Moose,   1979,  and  Moose,  Vanlandingham ,  and  McCabe,   1979).     This  approach 
assumes  that  the  time  spent  at  a  maneuver  amplitude  level  is  greater  than 
the  dynamic  response  time  of  the  Kalman  filter.     It  has  been  shown 
(Gholson  and  Moose,   1979),  that  increasing  the  number  of  discrete  maneuver 
levels  so  as  to  approaching  a  continuous  function  improves  this  estima- 
tor's performance. 

The  various  approaches  summarized  here  use  assumptions  which  permit 
the  use  of  the  theoretical  framework  of  Kalman  filtering  rather  than 
formulating  the  problem  as  the  conditional  mean  estimate  of  a  continuous 
system  driven  impulsively  by  a  compound  Poisson  process  with  continuous 
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measurements.     Previous  attempts  at  the  use  of  the  conditional  mean 
estimate  to  be  developed  in  this  paper  have  not  been  successful.  In 
this  dissertation,  the  filtering  equations  for  a  system  driven  by  a 
compound  Poisson  process  and  measured  with  additive  Gaussian  noise  will 
be  presented,  and,  where  previous  attempts  have  failed,  conditions  in 
which  improvements  are  achievable  relative  to  the  linear  filtering  approach 
will  be  defined. 


Statement  of  the  Problem 
The  system  to  be  estimated  is  described  by  the  following  stochastic 
differential  equation : 

dx^  =  a       dt  +  do^ .  1 
t  t  t 

This  system  is  driven  by  the  process    0^    which  is  a  compound  Poisson 
process  with  intensity    X    and  zero-mean  jump  amplitudes  governed  by  the 
probability  density    p^,  where    a    symbolically  represents  the  moment 
of  the  distribution,  i.e.,  is  mean,  is  variance,  etc.  The 

probability  that    k    jumps  occur  up  to  time    t    is  given  by 

P(n=k)  =  e"^^  -TT^.  t  >  0.  2 


The  process    x^    has  discontinuous  sample  paths. 

This  process  is  observed  by  the  measurement  process,    y^,  where 

dy^  =  c  x^  dt  +  dv^ .  3 

The  Brownian  motion  process,     v^ ,    has  the  variance    E(dvdv)  =  rdt. 

The  process  and    v^    are  assumed  independent.     Ihe  problem  addressed 

here  assumes  that  the  jumps  are  not  detected  or  observed  as  part  of  the 
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measurement  process.     It  is  also  assumed  that  the  model  (e.g.,  Johnson, 
1977),  and  the  associated  statistical  parameters  have  been  determined. 

Previous  work   (e.g.,  Fisher,  1967;  Fisher  and  Stear,  1967;  Eckberg, 
1970;  Kwakernaak,  1980;  and  Au,  1979)  developed  the  optimal  filter  for 
this  system  and  it  is  an  infinite  set  of  coupled  non-linear  stochastic 
differential  equations.     Simulation  techniques   (Eckberg,  1970;  and 
Kwakernaak,  1975)  have  been  used  to  evaluate  the  performance  of  truncated 
equations  at  various  truncation  points .     Conclusions  drawn  from  these 
simulations  have  been  unsuccessful  in  determining  whether  improvements 
are  obtainable  with  the  additional  equations  over  those  provided  by  a 
linear  or  Kalman  filter. 

The  problem  addressed  here  is  the  construction  of  an  approximate 
solution  to  the  optimal  filtering  equations;  the  solution  is  obtained 
from  an  infinite  set  of  optimal  filtering  equations.  Additionally, 
conditions  under  which  the  truncated   (suboptimal )  equations  exhibit 
improved  performance  over  the  linear  or  Kalman  filter  are  determined. 
It  will  be  shown  that  combinations  of  the  system  parameters    a,  X,  oi ,  c 
and    r    govern  the  filter  response  and  the  potential  for  improvement 
over  the  linear  filtering  equations. 

These  results  will  be  accomplished  by  establishing  the  optimal 
filtering  equations  using  quasimoment  functions.     Also,  limit  arguments 
are  used  to  establish  when  the  infinite  set  of  equations  decouple  and 
become  the  same  as  the  linear  equations.     "Hie  numerical  example  problems 
examined  in  the  previous  simulation  studies  will  be  used  in  this  research 
to  demonstrate  the  new  conditions  established  for  better  performance  of 
the  solution  to  the  truncated  non-linear  equations  over  the  linear 
filtering  eguations . 
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Review  of  Previous  Work 
Previous  developments  of  optimal  filtering  equations  for  the  systan 
in  equation  (1)  include  Wonham  (1955),  Fisher  (1967),  Eckberg  (1978),  and 
Rwakernaak  (1975).    Vfonham  obtained  an  optimal  estimator  for  the  random 
telegraph  wave.     Using  the  conditional  density  function,  Wonham  obtained 
a  non-linear  finite  dimensional  filter.     By  examination  of  the  stationary 
error  variance  of  the  non -linear  filter  and  of  the  standard  linear 
Vfeiner  filter,  Wonham  concluded  that  the  quantity  composed    of  the  pro- 
duct of  the  process  switching  rate  and  the  measuranent  noise  variance 
amplification  can  be  used  as  a  condition  to  judge  the  non-linear  filter's 
perf ormeuice.     It  was  shown  that  as  this  quantity  became  large,  the 
stationary  error  variance  of  the  two  filters  became  equivalent,  and  as 
this  quantity  approached  zero,  the  stationeiry  error  variance  of  the 
non -linear  filter  was  less  than  that  for  the  linear  filter.     A  new  combi- 
nation of  system  parameters  including  those  obtained  by  Wonham  is 
developed  for  applicability  of  the  filter  equations  examined  in  this 
research . 

Fisher  (1957)  developed  optimal  filtering  equations  for  a  general 
n-dimensional  non-linear  system  and  non-linear  measurements  of  the  state, 
and  for  the  case  where  the  system  was  driven  simultaneously  by  compound 
Poisson  and  Weiner  processes.     Filtering  equations  for  the  conditional 
mean,  covariance,  and  third  and  fourth  quasimoment  functions  were  obtained. 
Quasimoment  functions    were  used    because  both  the  characteristic 
function  and  the  probability  density  function  may  be  easily  and  directly 
expressed  in  terms  of  the  quasimoment  function;  see  Appendix  A.  Addi- 
tionally, assuming  higher -order  quasimoment  functions  to  be  zero  does  not 
imply  any  unusual  type  density  function  as  in  the  case  where  assuming 
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higher -order  central  moments  to  be  zero  implies  that  the  density  function 
contains  derivatives  of  all  orders  of  the  Dirac  delta  function.  From 
this  work,  it  was  shown  that  the  dimensionality  of  the  optimal  filter 
increases  rapidly  with  the  increase  of  state  dimension  necessitated 
because  of  the  quasimoment  terras.     Fisher  concluded  with  recommendations 
for  examining  the  stability  of  the  truncated  non-linear  equations  and  a 
simulation  study  to  determine  the  trade-off  between  truncation  and  esti- 
mation acciaracy  - 

Bckberg  (1970)  obtained  optimal  filtering  equations  for  the  system  of 
equation  (1  )  using  central  moments,  cumulants  and  quasimoments .  Using 
the  propagational  equation  for  the  conditional  density  function  developed 
by  Snyder  (1968),  and  the  Fourier  transform  properties  of  the  probability 
density  and  the  characteristic  functions,  the  optimal  filtering  equations 
were  obtained.     For  the  scalar  case,  Eckberg's  equations  differ  from 
those  obtained  by  Fisher.     Eckberg  presented  results  from  a  simulation 
study  of  an  increasing  number  of  stochastic  differential  equations  in 
the  truncated  filtering  equations.     Hie  results  presented  indicated 
that  with  increasing  jump  amplitudes,  the  truncated  filtering  equations 
yielded  lower  mean  square  error  than  the  linear  filter.    The  linear 
filter  had  better  performance  for  input  jump  amplitudes  below  certain 
levels.     Instabilities  with  the  higher  moment  filters  seemed  to  be  the 
most  difficult  problem  in  the  simulation.     Because  of  the  differences 
between  the  equations  obtained  by  Fisher  and  Eckberg,  an  alternate 
approach  seems  warranted. 

Kwakernaak  (1975)  applied  martingale  theory  to  filtering  problems  of 
linear  systems  excited  by  Poisson  white  noise  with  observations  corrupted 
with  additive  Gaussian  measurement  noise.     For  an  n-dimensional  system, 
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stochastic  differential  equations  for  the  conditional  density  function, 
central  moments  and  cumulants  were  derived,  and  two  approximate  methods 
for  solving  the  filtering  problem  were  developed.     Numerical  results  were 
presented  for  a  scalar  system  comparing  filter  performance  for  a  linear 
filter,  a  non-linear  filter  truncated  at  the  seventh  cumulant,  and  a 
non-linear  filter  obtained  by  a  Ritz-Galerkin  method.     Kwakernaak  also 
reported  difficulties  with  instabilities.     The  simulation  results 
presented  showed  no  significant  improvement  of  the  truncated  cumulant 
filter  over  the  linear  filter.     In  the  case  examined,  the  cumulant 
filter  performed  better  when    x^    was    small  but  deteriorated  when 
x^    was  large.     The  system  parameters  for  this  example  were  significantly 
different  than  those  used  by  Bckberg   (1970).     Also,  the  trends  in  the  per- 
formance of  the  non-linear  filters  with  input  amplitude  were  contrary  to 
other  results.     Kwakernaak  expressed  an  interest  in  establishing  bounds 
on  the  possible  improvement  of  the  non-linear  filter  over  the  linear 
filter.  This  led  to  the  conditions  developed  and  evaluated  in  this  research. 

Recently,  Au  (1979).  motivated  by  the  poor  filter  performance 
reported  by  Kwakernaak   (1975),  developed  a  suboptimal  sequential  smoothing 
scheme.     As  motivation  for  the  smoothing  approach,  Au  showed  that  as 
the  Poisson  rate  parameter,     X,     tends  to  zero,  a  linear  filter  performs 
poorly.     In  this  proof,  the  rate  parameter  was  the  only  system  parameter 
used  in  the  limiting  arguments.     Not  proven  in  these  works  but  referred 
to  in  the  work  of  Kwakernaak,  was  the  statement  that  optimum  filters 
perform  poorly.     The  case  of  low-intensity  Poisson  Jump  amplitudes  is 
examined  herein,  and  a  counter  example  presented. 

In  this  work,  the  quasimoment  functions  will  be  used  to  develop 
the  optimal  filter  equations.     Filtering  equations  up  to  the  sixth 
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quasimament  will  be  developed.     Filtering  equations  up  to  the  fourth 
quasiraoment  will  be  shown  to  be  in  agreement  with  those  of  Fisher  (1 967 ) . 
Conditions  under  which  the  truncated  filtering  equations  approach  or 
deviate  from  the  linear  filtering  equations  will  be  developed  via  the 
conditional  characteristic  function.     Stationary  quasimoments  and  limit 
arguments  using  combinations  of  system  parameters  will  be  used  to  show 
that  the  truncated  non-linear  filtering  equations  decouple  and  become  a 
linear  filter  again  under  certain  limits.     This  implies  that  only  in 
the  counter  case,  strong  coupling,  can  the  non -linear  filtering  equations 
have  the  potential  for  improved  performance  over  the  linear  equations. 
Hie  existence  of  stationary  values  of  the  quasimoments  requires  stability 
of  the  filtering  equations.     Conditions  for  the  truncated  non-linear 
filtering  equations  will  be  established.     Finally,  using  the  previously 
published  numerical  example  problems,  the  conditions  established  for 
improved  filter  perfomance  will  be  examined  to  confirm  the  perfomance 
improvements . 

Dissertation  Outline 

In  Chapter  IWo,  the  optimal  filtering  equations  are  developed  for 
the  system  described  by  equations  (1  )  and   (3).     Following  the  martingale 
approach  of  Kwakernaak  (1975),  the  stochastic  differential  equation  for 
the  conditional  characteristic  function  is  derived.     Hien,  departing 
from  Kwakernaak  (1 975 ) ,  the  quasimoment  function  is  used  to  develop  the 
optimal  filtering  equations  up  to  the  sixth  quasimament. 

In  Chapter  Ihree,  the  conditions  of  performance  of  the  non-linear 
filtering  equations  relative  to  the  linear  filtering  equations  are  derived. 


First,  the  truncation  of  the  filtering  equations,  via  the  conditional 
characteristic  function,  is  performed  to  determine  in  general  the  condi- 
tion for  deviation  from  or  convergence  to  the  linear  filtering  case. 
Then,  to  serve  as  motivation  for  examining  non-linear  filtering  equations' 
performance,  stability  and  performance  of  the  linear  filter  equation  is 
examined  using  Lyapunov  techniques.     Next,  the  stability  and  decoupling 
of  the  non-linear  filtering  equations  are  investigated  as  the  system 
approaches  the  conventional  Gaussian  problem  for  low  signal-to-noise 
conditions.     A  constraint  to  maintain  stability  of  the  non-linear  filtering 
equations  is  established  using  Syapunov  techniques. 

In  Chapter  Four,  numerical  results  are  presented  for  examples  pre- 
viously reported  in  the  literature.     Conditions  of  low  and  high  signal- 
to-noise  are  numerically  investigated  and  the  results  presented.  Using 
the  example  problem  of  Kwakernaak  (1975)  and  a  new  example  problem,  per- 
formance improvement  of  the  non-linear  filtering  equations  is  demonstrated. 
These  numerical  examples  confirm  the  analytical  results  including  the 
stability  constraint  developed  in  Chapter  Three. 

Chapter  Five  presents  corresponding  developments  for  an  unstable 
system  as  those  presented  in  Chapters  Three  and  Four . 

Finally,  in  Chapter  Six,  conclusions  of  this  work  and  recommendations 
for  future  work  are  presented.     Appendix  A  provides  a  review  of  quasi- 
moment  functions  from  Fisher  (1967).     The  optimal  filtering  equation 
using  the  martingale  approach  from  Kwakernaak   (1 975 )  is  given  in 
Appendix  B.     A  listing  of  the  computer  program  used  to  generate  the 
numerical  simulation  results  is  provided  in  Appendix  C. 


CHAPTER  TWO 
DEVELOPMENT  OF  OPTIMAL  FILTERING  EQUATIONS 

Introduction 

In  this  chapter,  the  first  six  of  the  infinite  sets  of  optimal 
filtering  equations  are  derived.     Following  the  approach  of  Kwakernaak 
(1975)  in  the  use  of  martingale  theory,  the  differentiation  rule  of 
Doleans-Dade  and  Meyer  referred  to  by  Kwakernaak  (1975)  and  the  funda- 
mental filtering  theorem  of  Kwakernaak 's  are  used  to  obtain  the  stochas- 
tic differential  equation  for  the  conditional  characteristic  function. 
Then,  departing  from  Kwakernaak  (1975),  the  optimal  filtering  equations 
in  terms  of  quasimoment  functions  are  derived  up  to  the  sixth  quasi- 
moment.     It  is  shown  that  the  filtering  equations  up  to  the  fourth 
quasimoment  are  in  agreement  with  the  scalar  version  of  the  results  of 
Fisher  (1967).     Truncated  forms  of  these  filtering  equations  are  examined 
in  the  following  chapter  as  an  approximate  solution  of  the  filtering 
problem. 


Conditional  Characteristic  Equation 


Differentiation  Rule 

Here  the  Doleans-Dade  and  Meyer  differentiation  rule  will  be 
summarized  from  Appendix  B.     Let  the  process     x^     be  a  discontinuous 
semi-martingale,  and  let    (p    be  a  twice  dif ferentiable  function  of  x^ . 
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Then  the  process    Q    =  (p(x  )     is  also  a  semi-martingale,  such  that 

C  C 

dQ.   =  (p  (x,    )dx    +  K<P^^(x.    )d  <  X  ,  X  >  ] 

4 

^  ^  t  <i<t  ^''^''s^  -  "P^V^  -  ^x^V^^^s  -  V^^ 

o-  - 

where    (p      and    m        are  the  first  and  second  partial  derivatives  of 

^X  XX 

the  function    (p ,  and    x^    is  the  continuous  part  of    x    and  the  summation 
is  carried  out  over  those  values  of    s    where    x    jumps.     The  last  term 
in  equation  (M)  distinguishes  it  from  the  Ito  differentiation  rule 
(e.g.,  Jazwinski,   1970)  for  Gaussian  driven  systems.     Other  differen- 
tiation rules,  such  as  the  Kushner-Stratonovich  equation  (e.g.,  McGarty, 
1974)  for  propagating  the  conditional  probability  density  function,  can 
also  be  used  to  obtain  the  desired  equations. 


Propagating  the  Conditional  Characteristic  Function 
For  equation  (4),  define  the  function  as 

=  e  5 

where  i  =^  -1  and  u  is  real.  Then  applying  equation  (M)  to  this 
function  results  in 


iux„  lUX,  .  lux, 

J/        "\       •  t,,       .  „,  lua  t,, 

d(e        )  =  luax^e        dt  +  ^^E(e        -  1)e  dt 


lUX  lUX  .  lux, 

J        ^       /         s  S-,       ,  „,   lua  t  . 

+  d  ,     1^.    (e  -  e  )  -  X.E(e        -  1)e  dt 

t  <s<t  t 
o-  - 
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Application  of  the  basic  filtering  theorem  from  Appendix  B  to  the  semi- 
martingale  yields 

-^Uix^  ^lAix>  .  iux 

d(e      ^)  =  iua  x^e      ^  dt  +  X^ECe^""*  -De  dt 


iux^  ■'■'^^t  -1 

+  (x  e         -  X    e        )  cr    [dy  -  cxdt] 


From  the  definition  of  the  conditional  characteristic  function 


A  lUX^ 

(l-^Cu)  =  e 


and  substitution  of  this  equation  into  equation  (7)  results  in 


dfl',  (u)  =  au4''(u)dt  +  X>  (u)(e^"°'  -  1)dt 

U  O  u  t- 


-  [itp^Cu)  +  x^(|'^(u)]cr      [dy^  -  cx^dt] 

where  the  prime  denotes  the  partial  derivative  of  with  respect 

to    u.    Equation  (9)  is  the  desired  equation. 


Quasimoment  Filtering  Equations 
At  this  point,  a  departure  from  Kwakernaak  (1975)  is  made.  The 
departure  is  from  the  use  of  cumulants  or  central  moments  to  quasimoment 
functions  used  to  define  the  characteristic  function. 


Quasimoment  Functions 

From  Appendix  A  it  was  seen  that  the  characteristic  function  'f')-(^) 
can  be  expressed  as 
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,     s  t  t        r ,  S     (lU)        ,       1  Hft 

(L  (u)  =  e  {1  +  — 1       k  1 

*t  n=3  nl  n 

where  the    k  's    are  the  quasimoment  functions.    In  Appendix  A  it  was 
n 

seen  that  the  first  and  second  quasimoments  were  zero.     From  equation 
(10)  it  is  seen  that  if  all  of  the    k's  are  zero,  then  the  characteristic 
function  describes  a  Gaussian  process  with  mean    x^    and  variance  P^. 
By  using  this  expression  for  the  characteristic  function,  the  deviation 
from  or  approach  to  a  Gaussian  process  can  be  readily  obtained. 


Filtering  Equations 

To  obtain  the  optimal  filtering  equations,  the  characteristic  function 
in  equation  (10)  is  substituted  into  equation  (9).     Using  the  differen- 
tiation rule  with  equation  (10),  collecting  terms  in  like  powers  of  u 
and    dropping  terms  of    o(dt)  the  derivation  is  completed.     This  process 
is  followed  below  for  each  term  in  equation  (9). 

First,  the  characteristic  function  from  equation  (10)  is 

iux^-5uP^u  3  ^  5 

.,,  t        tr,       -u,         u,         .u  -I 

4;^(u)  =  e  [1  -  1  jr  k^  +        k^  +  1  —  .   .  .] 

so  that  an  expansion  of  the  exponential  function  yields 

2  3  ^ 

4-^(u)  =  1  +  iuX  -  |-  (P  +  X  )  -  i  jr  (3Px  +  x^  +  k^) 

+  ^  (x'^  +  6Px^  +  3P^  +  ^k^x  +  k^)  11 

+  i  H.-  [x^  +  ^  PX^  +  15P^x  +  10k^(P  +  x^)  +  5k,,x  +  k^]  +  O(u^). 
512  3  4  3 
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Taking  the  partial  derivative  with  respect  to    u    of    <P^^(u)     in  equation 

d(\> 

(11),  the  first  term  on  the  right  hand  side  of  equation  (9),     au  g^dt, 
becomes 

-...3 


au  5i  dt  =  [iuax  -  H_  (2aP  +  2ax'^)  -  ^  (3aPx  +  3ax^  +  3ak  ) 
ou  ^  J  • 


+  ^  (Max^  +  24aPx^  +  12aP^  +  l6ak^x  +  4akj^)  12 
.  5 

+  ^  {5aK  +...)+..  .]dt. 

5:  5 


The  second  term  in  equation  (9)  is  obtained  by  expanding  the  characteris- 
tic function    e'''"°'    in  terms  of  its  moments  .a^  obtaining 

2  3  2 

XcKe^""  -  Ddt  =  X{iua^  -  +  a^x)  -  i  j^ioL^  +  Ba^x  +  P  +  x  ) 
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+  ^"l^  +  ^"3^  +  12a2(P  +  x  )  +  3P  +  X  ]  +  .   -   -  dt. 


The  last  term  in  equation  (9)  is  obtained  in  a  similar  fashion  and 
becomes 

[i  ^  +  x(L(u)]cr~^  [dy  -  cxdt]  = 
6u 

2  3  p  p 

[iuP  -  ^         +  2Px)  -  i  j^(k^  +  3Px    +  3k^x  +  cP"")  1M 

u**  -1 
+        (k^  +  .   .   .]  cr     [dy  -  cxdt]. 

Now  the  left  hand  side  of  equation  (9)  will  be  evaluated.    Expansion  of 


d(|;  yields 


15 

2 

d(p  =  iud(x)  -  ^(d(P)  +  d(x^))  -  i  jr(3d(Px)  +  d(x^)  4-  d(k^) 


•3  -.3, 
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Collection  of  like  powers  of  "u"  in  equations  (15),   (12),   (13),  and 
(1M)  yields  for  iu 

CHv   _   pvdh")    4-   \n   dt  .  16 


dx  =  axdt  +  Per      (dy  -  cxdt)  +  Xot^ 


2 

For  collection  of  terms  of    o(dt)  and  recognition  that 

dxdx  =  Pcr~^cPdt  +  o(dt)  17 


yields 

dP  =  2aPdt  +  k^cr~\dy  -  cxdt)  -  Pcr~^cPdt  +  Xa^dt.  18 
3 

For  i  J7-,     collection  of  terms  of    o(dt)  and  recognition  that 

dPdx  =  k2Pcr"''cdt  +  o(dt)  19 
yields 

dk^  =  3ak^dt  +  k^cr~\dy  -  cxdt)  -  dk^Pcr"^  cdt  +  Xa^dt.  20 

For    -^j,     a  similar  set  of  steps  yields 

-1  -1  2  -1 

dkj^  =  Mak^dt  +  k^cr     (dy  -  cxdt)  -  4k^Pcr    cdt  -  3k2cr  cdt 

+  Xa^dt  21 
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where 


dk^dx  =  k,Pcr"^cdt  +  o{dt)  22 
3  4 


and 


dPdP  =  k^cr'^cdt  +  o(dt).  23 

At  this  point,  equations   (17),   (18),   (20)  and  (21)  are  the  scalar 
versions  of  the  results  of  Fisher  (1967).     This  alternate  approach  in 
the  filtering  equation  derivation  confirms  their  correctness.  The 
results  obtained  by  Eckberg   (1970)  differ  in  that  starting  with  the 
first  of  these  filtering  equations,    n  =  1,     an  extra  term,  ~\_^.2 
appears  in  the  n^^    equation.     The  difference  between  Eckberg' s  equation 
and  those  derived  here  stems  from  Eckberg 's  use  in  the  start  of  his 
derivations  of  a  conditional  probability  density  function  that  is 
questionable.     The  results  in  equations   (17),   (19),   (22  and  (23)  are 
obtained  from  the  relationship    dydy  ~  0 (dt ) . 

Continuation  of  the  process  for    k^     and    k^  yields 

dk^  =  Sak^dt  +  (k^  -  1 0k^  )cr"^  (dy  -  cxdt) 

5  b  b  J 

-  5k^Pcr~^cdt  -        k,Pcr~^cdt  +  Xa  dt  24 
5  2      4  5 


dk^  =  6ak^dt  +  (k^  -  1 5k^  )cr  ^  (dy  -  cxdt) 
5  5  7  4 


-  Sk^Pcr  ^cdt  -  3k^k_cr  ^cdt  -  ^  k^cr  ^  cdt 
o  b   J  z  4 


+  X(Qt     +  20ot^k,  )dt.  25 
5  3  3 
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For  applications  other  than  a  scalar  problem,  the  sixth  quasimoment 
equations  would  result  in  considerable  complexity  for  implementation. 
The  first  moment  is  a  vector,  the  second  a  matrix,  the  third  is  a  third 
order  tensor,  etc.     Consequently,  the  process  of  deriving  the  optimal 
filtering  equations  will  be  terminated  at  this  point. 

Summary 

In  this  chapter,  the  optimal  filtering  equations  have  been  obtained 
up  to  the  sixth  quasimoment  equation  via  quasimoment  functions.     It  can 
be  seen  from  these  equations  that  if  the  quasimoments  are  zero,  the 
usual  linear  filter  is  obtained.     The  non-linear  equations  are  used  in 
the  next  section  to  obtain  approximate  solutions  by  truncation  of  this 
set  at  arbitrary  points.     Up  to  the  fourth  quasimoment,  the  results 
obtained  are  the  same  as  the  scalar  version  of  those  obtained  by  Fisher 
(1967)  using  an  alternate  approach. 


CHAPTER  THREE 
PERFORMANCE  OF  THE  FILTERING  EQUATIONS 

Introduction 

In  this  chapter,  the  performance  of  the  truncated  filtering  equa- 
tions will  be  addressed.    First,  using  the  conditional  characteristic 
equation,  it  will  be  shown  that  only  for  the  case  of  systems  driven 
by  continuous  Gaussian  white  noise  will  the  filtering  equations  become 
linear.     This  represents  a  truncation  of  the  optimal  filtering  equations 
at  the  second  moment  equation.     It  will  be  shown  that  only  under  limit- 
ing conditions  of  large  jump  rate  and  small  jump  amplitudes  will  this 
be  a  condition  for  the  optimal  filtering  equations  to  converge  to  the 
linear  filter. 

Next,  the  performance  of  linear  filtering  equations  is  examined 
using  a  Lyapunov  function.     It  is  shown  that  the  performance  of  the 
linear  filter  depends  on  a  combination  of  response  and  stability. 

The  non-linear  filtering  equation's  performance  will  be  examined 
under  two  conditions,  low  and  high  signal-to-noise,  representing 
combinations  of  the  system  parameters.     For  the  low  signal-to-noise 
condition,  use  is  made  of  the  stability  theorem  of  Perron  (e.g.,  Bucy 
and  Joseph,   1968)  to  demonstrate  stability,  and  given  stability,  with 
stationary  values  of  the  quasimoments ,  demonstrate  the  expected  poor 
performance  of  the  truncated  filtering  equations  and  the  decoupling  of 
the  higher  moments.     For  the  high  signal-to-noise  condition,  use  is 
made  of  a  Lyapunov  function  constructed  by  Krasovskii's  technique 
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(e.g.,  Ogata,  1967).    Using  this  technique,  conditions  for  truncated 
filter  stability  are  established.     Couplings  between  the  higher  moments 
of  the  filtering  equations  are  shown  to  be  significant  using  the  values 
of  the  stationary  quasiraoments . 

As  an  outcome  of  the  Lyapunov  stability  analysis  of  the  truncated 
non-linear  filtering  equations,  two  conditions  are  established  for 
filter  stability.     The  first,  that  the  system,  equation  (1),  be  stable, 
and  the  second  that  the  second  moment,  the  estimation  error  covariance, 
be  positive  semi-^def inite  are  required  for  filter  stability.     In  the 
next  chapter,  numerical  examples  will  be  presented  to  demonstrate 
filter  performance  with  and  without  the  imposition  of  the  second  of 
these  two  constraints. 

Convergence  to  the  Optimal  Linear  Filter  —  The  General  Case 
Here,  the  conditions  for  the  convergence  to  an  optimal  linear  filter 
for  the  general  case  will  be  examined.     Following  the  idea  of  Eckberg 
(1970),  the  conditional  characteristic  function  for  the  estimation 
error  will  be  used  to  show  that  only  when  the  characteristic  function 
of  the  driving  noise  is  an  even  function  of  the  dummy  variable  "u" 
and  is  quadratic  will  the  optimal  filter  be  linear  with  a  deterministic 
second  moment  (estimation  error  variance). 

The  characteristic  function  for  the  compound  Poisson  process  is 
an  even  function  of    "u"    when  the  jump  amplitude  is  symmetrically 
disturbed  with  zero  mean.     It  will  be  shown  that  only  when  the  jump 
amplitudes  become  infinitesimal  with  large  jump  rates  will  an  optimal 
linear  filter  be  approached. 
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Conditional  Characteristic  Equation  for  the  Estimation  Error 
The  conditional  characteristic  equation  for  the  estimate,  equation 
(9),  is  rewritten  here  as 

94-  -1 

d(L     =  ua  — -  dt  +  Even(u)dt  -  [i  - —  +  x(|;  ]cr      [dy  -  cxdt]  26 
6u  ou  X 

where  the  subscript  denotes  the  characteristic  function  for  the  estimate, 

,   .   ,  ,  ,  iuct      , , 

x^.     The  characteristic  function  for  the  driving  noise,     X^((>^(u)(e        -  >), 
for  the  compound  Poisson  process  has  been  replaced  by  Even(u)  to  denote 
an  even  function  of    "u."    The  estimation  error  is  defined  as 
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x  -  X. 


The  characteristic  function  for  the  error  then  becomes 


(I)  =  e  (b  .  28 
^e  X 


Using  this  relationship,  the  following  equations  result: 


d(|;^  =  e^^'^Eiudxcp^  +  d^.^]  29 


and 


^x        luxp...  ^e-i 

e      Lix(|<    +  - — ]  .  30 


au  ^e  au 


The  substitution  of  equations  (29)  and  (30)  into  equation  (26)  yields 

d(b    =  us  - —  dt  +  Even(u)dt  -  i  - —  cr     [dy  -  cxdt] 
e  au  au 


-  iudx(L    +  iuaxd)  dt.  31 
e  e 

This  is  the  equation  of  the  conditional  characteristic  function  for  the 
estimation  error  given  by  equation  (27). 
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Solution  for  Continuous  Gaussian  Driving  Noise 

For  continuous  Gaussian  driving  noise  in  equation  (1),  from 
Jazwinski  (  1970),  the  characteristic  function    tl*^  is 


A,    =  e"^"^^.  32 


The  characteristic  function  for  the  driving  noise  is 


Even(u)  =  -  Jcp^uqu  33 

where    E(dodo)  =  qdt .     From  equation  (32)  the  following  symmetry 

'  '  A 

properties  hold  for  the  function    i\>  (u)     defined  as    (I'  (u)  =  (p  (-u); 


<\.  iu)  =  <\,  (-u)  3^ 
^e  e 


4,  (u)  =  4,'  (-u)  35 
^e  e 


d4<^(u)  =  d<p^(-u)  36 


84.  (u)  d(\>  (-u) 

—          =   37 

au  au 


Using  these  relationships,  an  equation  for    (l)^(-u)     can  be  obtained. 
This  equation  is 

d<\.\-u)  ,  d<\.  \-u)  _^ 

dd(  (-u)  ^  ua —   dt  -  iuqu  d*  (-u)dt  +  i   cr     (dy  -  cxdt) 

e  au  e  au 

+  iudx4>^(-u)  -  iuax  (p^(-u)dt.  38 

Substituting  equation  (33)  into  equation  (31),  substracting  equation 
(38)  from  equation  (31)  and  using  equation   (36)  yields 
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64-  (u) 

0  r  —          cr~    (dy  -  cxdt)  +  udx  <|;  (u)  -  uaxdt  ^  (u)  .  39 

5u  6  e 

This  equation  is  a  differential  equation  for  4.^(u) .    The  solution  of 
equation  (39)  is 

,  .            ,  ,        dx  -  axdt  ,  jin 

(j,  (u)  =  exp(-Ju  — —   u).  '^O 

^        _  cr     (dy  -  cxdt) 

From  equations  (40)  and  (32)  the  following  is  obtained: 

dx  =  axdt  +  Pcr~\dy  -  cxdt).  41 

This  equation  is  identical  to  equation  (16)  when  =  0.     Instead  of 

subtracting  to  obtain  equation  (39),  adding  the  equations  yields 

34.  (u) 

d4,^(u)  =  2au  — ^ —  dt  -  2  •  Juqu  (l<^(u)dt.  42 

Using  the  differentiation  rule,  equation  (4),  on    'I'g^u)     defined  by 
equation  (32)  yields 

1  p  InPn 

dd.  (u)  =  (-dP  -  Per    cPdt)u    e^        +  o(dt).  43 
e 

From  equations  (43)  and  (42)  ,  the  estimation  error  covariance  is 

dP  =  2aPdt+  qdt  -  Pcr"^cPdt.  44 

Therefore,  for  the  case  of  continuous  Gaussian  driving  noise,  a  linear 
filter  with  deterministic  error  variance  is  obtained.     That  is,  the 
error  variance  is  not  coupled  with  the  state  estimate,     x  . 
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Compound  Poisson  Process  Driving  Noise  Approach  to  Gaussian 
For  this  case,  the  function    Even(u)    can  be  written  as 
2  4 

Even(u)  =  C-  ^         +  ^  Xa^  +  .   .   .1<\> ^(u)  45 

Since  this  function  is  even,  the  process  used  to  obtain  equation  (40) 
will  also  produce  the  same  equation  as  equation  (40).     However,  picking 
the  process  up  at  equation  (42),  higher  powers  of  "u"  enter  the  equations 
as  a  result  of  equation  (45).     If  all  terms  above  the  quadratic  in 
equation  (45)  were  zero,   i.e.,     Xa^  -  0,     then  the  above  process  will 
again  yield  a  linear  filter  with  deterministic  second  moment.     If  this 
were  not  true,  then  equation  (32)  would  have  to  be  amended  to  provide 
higher  powers  of  "u" ;  therefore  partial  derivatives  in  equation  (42) 
would  produce  additional  terms  as  in  the  application  of  the  differen- 
tiation rule. 

In  general,  the  optimal  filter  becomes  linear  when  all  terms 
Xa^^ ,  Xa^ ,    .   .   .     become  zero.     It  has  been  shown  (e.g.,  Laning  and 
Battin,   1956  and  Snyder,   1975)  that  a  compound  Poisson  process  tends 
to  a  continuous  Gaussian  process  in  the  limit  as  the  Poisson  rate 
parameter    X  -  <»    and  the  amplitude  variance,     ot^  -  0    while  the  product 
Xoi^     is  a  constant.     If  the  amplitude  distribution  for  the  jumps  is 
such  that  higher  moments  are  related  to  lower  moments  by  a  power,  i.e., 
a.^  _       '  ^  ^  ^'     then  the  above  limiting  process  will  then  yield  a 
linear  optimal  filter.     This  case  will  be  examined  later  using  sta- 
tionary quasimoments ,  where  the  same  result  will  be  obtained. 

From  these  arguments,  only  in  the  limits      X        ,  a.^      0  as 
Xttp  =  constant    will  the  optimal  filter  become  linear.     Other  conditions, 
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based  on  the  system  parameters    a,  X,  ot^,  c    and    r,   will  be  established 
to  determine  when  the  truncated  filtering  equations'  performance  yields 
improved  performance  compared  with  the  linear  filter. 


Linear  Filter  Performance 
The  linear  filter  performance  can  be  assessed  by  examining  the 
rate  of  convergence  of  the  Lyapunov  function 

V(x)  =  xP~^x  i*6 
where    x  satisfies 

dx/dt  =  (a  -  Pcr~^c)x  4? 

and    P    is  given  by  the  variance  equation 

dP/dt  =  2aP  +  Xot  -  Pcr~^cP.  48 

Filter  stability  is  assured  if    V(x)     is  strictly  negative.  Therefore, 

•      av_     3V  dx 

^  9t  dt 
9x 

__  _  ^a?Mt  _  2  dx/dt^^ 


-  [(2a  +        -  Pcr~^c)   -  2(a  -  Pcr~^c)]V 


.-.  V  =  -l^  +  Pcr~^c]V  50 

Xa  1 

implies  that  the  larger    —    and     Per    c    then  the  more  rapid  the 
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convergence  of  the  linear  filter  to  its  estimate.  For  the  scalar  constant 
system  that  is  stable,  the  stationary  value  of  .  P    is  given  as 


51 


Therefore,  these  two  quantities  can  be  expressed  as 


Xac 


Xa  ar 


Improved  linear  filter  performance  is  obtained  when  these  two  quantities 
are  large . 

,  2 

First,  examine  the  stationary  signal-to-noise  ratio  — — ,  when 
2  '  JO  2ar 

Xotc 

  »  1  .    This  limit  yields  the  following  relationships: 

ar 


Xa  /  Xa 

—  -  c 


P 


r 


54 


P-C^  55 


These  two  quantities  now  become  independent  of  the  system  parameter     "a.  " 


Xa 

Also,  the  larger  the  quantity  ~\/  —  ,  then  the  more  rapidly  converging 
and  stable  the  linear  filter  is. 
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Xotc 

When    «  1 ,    these  two  quantities  can  be  approximated  as 

ar 


^_-2a  56 


-  2  2 
Pc     _  Xac 

r  2ar 


The  latter  of  these  two  is  the  signal-to-noise  ratio.     If  the  condition 

2  -  2 

Xotc  Pc 

 «  1     is  satisfied,  then    is  also  small.     Therefore,  the  con- 

ar  r 

vergence  depends  on  the  system  parameter  "a. "  Reexamining  the  variance 
for  this  condition  yields 

p  -  -  i  « 


which  is  just  the  process  noise.    Under  this  condition  even  though  the 
filter  is  stable,  there  is  little  improvement  over  the  process  uncer- 
tainty by  using  filtering. 

In  summary,  the  optimal  linear  filter  performance  improves  when 

— —  »  1     or    c  ~y /  —  >    a.     The  filter  is  stable  but  yields  poor 
a  r  V 

performance  when  «  1. 

ar 


Performance  of  the  Truncated  Non-linear  Filter 
Here,  the  stability  and  asymptotic  performance  of  the  truncated 
non-linear  filtering  equations  will  be  discussed.     Using  the  previous 
results  for  the  linear  filter  as  motivation,  the  filter  stability  and 
asymptotic  performance  for  low  signal-to-noise  will  be  addressed.  This 
condition  will  result  in  negligible  coupling  between  the  higher  moments 
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of  the  filtering  equations.    Then  the  stability  of  the  truncated  non- 
linear filtering  equations  will  be  addressed.     Two  conditions  for  their 
stability  will  be  established.     Assuming  compliance  with  these  two 
conditions  assuring  the  existence  of  stationary  values  for  the  quasi- 
moments,  non-negligible  couplings  will  be  shown  to  exist  between  the 
truncated  non-linear  filtering  equations  for  large  signal-to-noise 
conditions . 

Stability  of  the  Non-linear  Filtering  Equations 

The  non-linear  filter  performance  is  comprised  of  responsiveness 
and  stability  as  in  the  case  of  the  linear  filter.     To  evaluate  the 
filter's  stability,  it  is  instructive  to  rewrite  equations  (16),  (18), 
(20),   (24)  and  (25)  as  a  non-linear  vector  stochastic  differential 
equation  as  shown  in  Table  1 .     It  is  seen  from  this  table  that  the 
equations  are  coupled  and  exhibit  different  characteristics  for  each 
additional  pair  of  moments  included  in  the  state  vector     i.e.,  x 
and  P;     x,  P,        and         etc.     Up  to  the  fifth  quasimoment  term,  the 
innovations  process      (dy  -  cxdt)      enters  into  a  moment  equation  by 
the  next  higher  moment.     Rewriting  the  equation  in  Table  1  as  shown 
in  Table  2    allows  the  view  of  these  equations  as  those  comprised  of  a 
"linear"  term,     Ax_,     and  non-linear  coupled  terms.     This  can  also  be 
illustrated  by  the  following  vector  stochastic  equation: 

dx  =  Axdt  +  h(x,  t)  dt  +  r(x,  t)  ^  dy  59 

If    A    were  a  stable  constant  matrix,  then  use  of  Perron's  theorem 
(e.g.,  Bucy  and  Joseph,   1968)  can  be  made  to  evaluate  the  system 
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TABLE  1 

NONLINEAR  FILTERING  EQUATIONS  UP  TO  THE  SIXTH  QUASIMOMENT 


+  — (dy  -  cxdt ) 


+  -(dy  -  cxdt)  2.(5..  t) 
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TABLE  2 

REFORMULATED  NONLINEAR  FILTERING  EQUATIONS  FROM  TABLE  1 


dx 

a  -   

r 

0 

0 

0 

dP 

0 

2a  

r 

0 

0 

dkj 

0 

0 

3(a  -  fsi) 
r 

0 

dK^ 

0 

0 

0 

4(a  - 

0 

0 

0 

0 

!\ 

0 

0 

0 

0 

dx 

Axdt 

dt  + 


*  h(x,  t)dt 


0  0 

1  0 
0  1 
0  0 


0 
0 
0 

1 

0 

15  0 


dy; 


r(x.  t)-  dy 
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lb' 

stability-    The  matrix    A    is  stable  when     (a  )  <  0  and 

2 

(2a  -  <  0.     The  first  of  these  will  reappear  later  for  non-linear 

r 

filtering.    Examining  the  vector    h(x,  t)     term  by  term,  it  is  seen  that 
if  products  of  the  first  moment,     x,     and  the  quasimoments  are  small, 
such  that    h(x,  t)     is  of  order    o( | |   x  ||),  then  the  equation  (59) 
is  asymptotically  stable.     Under  these  conditions,  stationarity  of  the 
quasimoments  is  assured.     This  low  degree  of  coupling  corresponds  to 
low  signal-to-noise  or  a  near  Gaussian  process  in  the  limit  discussed 
earlier.     This  will  be  demonstrated  later. 

If  the  couplings  between  the  equations  are  not  of  order    o( | |  x  ||), 
then  Lyapunov  techniques  are  required  to  determine  the  conditions  for 
stability . 

The  equations  in  Table  1  will  be  examined  to  evaluate  their 
stability  when  the  non-linear  terms  are  not  negligible.     The  stability 
shall  be  evaluated  using  Krasovskii's  Theorem  (e.g.,  Bucy  and  Joseph, 
1968).     For  a  general  non-linear  system  of  dimension    n,     the  system 
is  described  by  the  following  vector  differential  equation. 

X  =  f (x)  60 

Let  the  Jacobian  of  '  f(x_)     be  given  by    F(x_).     Krasovskii's  Theorem 
states  that  if    £(0_)  =  0_    and    F(x_)     is  negative  definite  where  F(x_) 
is  defined  as 

F(x)  =  f'^(x)  +  F(x)  61 
where  superscript     "T"    denotes  transpose,  then  the  equilibrium  state 
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X  =  0    is  asymptotically  stable.    Hie  Lyapmov  function  is  given  as 

V(x)  =  fju)  f  (x)  ^2 

with 

m  ^ 

V{x)  =  f   (x)  F(x)  f (x).  63 

Additionally,  if    V(x)    tends  to  infinity  as     | |  x  M  "* 
equilibrium  state  is  asymptotically  stable  in  the  large. 

The  system  of  equations  to  be  evaluated  with  this  Lyapxinov  function 
construction  technique  must  have  zero  as  their  equilibrium  state.  For 
the  first  three,  up  to  the  third  quasimoment,  the  unforced  equations 
are  written  as 

Pc^  . 

dx/dt  =  ax  -    X 

r 

PC^ 

=   (a  -  — )  X  64 
r 

2  2      k  xc^ 

dP/dt  =  2aP  -  — —  -    +  Xa- 

r  r  <i 

2  k  xc^ 

=   (2a  -  — )  P  -  —         +  Xa^  65 

r  r  2 

3k  Pc^  ^.y^c^ 

dk_/dt  =  3ak^  -  —         -  —  

3  3         r  r 

^  2  k,xc^ 

Pc  4 

=  3(a  -  — )  k,  -  —   65 

r        3  r 

where  the  zero  mean  property  of  the  compound  Poisson  process  has  been 

used.     For  these  equations,  P    and    k^    have  nonzero  equilibrium 
conditions . 
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For    P,     with  the  equilibrium  value  associated  with  its  positive 
semi-definite  value  is  given  as 


67 

2 

c  a  r 


and  defining" 

P  =  P  -  P  68 
ss 

the  desired  equation  is 

2 

;  p2  2      k  xc 

p  =  2aP  -  —  ^   69 


where 


a  =  ay     1  +  — - —  70 

a  r 


Below  are  the  resulting  equations  for  zero  equilibrium  conditions. 

Pc^ 

dx/dt  =  (a  -  — )  X  71 
r 

^  2 
2  2      k  XC 

dP/dt  =  2aP  -  —   72 

r  r 

-  k  xc 

dk  /dt  =  3(a  -  k    -  73 
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The  Jacobian,    F(x),     for  equations  (71)  through  (73)  is 


F(x) 


(a  -  — ) 


.  2 
xc 


2(a  -  — ) 

2 


Sk^c 


xc 


Pc 

3(a  -  ^) 


7M 


and  the  matrix    F(x)  becomes 


F(x) 


2(a  ) 


(x  +  k.)  - 
3  r 


-(X  .  k^)  ^ 


Pc 

4(a  -  — ) 
r 


k^c 


■(X  +  3k3)  ^ 


2  -       p  2 

.(X  +  3k3)  2-       6(a  -  ^^) 


75 


To  determine  the  requirements  for  the  negative  definiteness  of  the 
matrix,     F(x),  Sylvester's  criteria  (e.g.,  Ogata,   1 967 ) are  used  .  Apply- 
ing these  criteria  yield    the  following  inequalities  as  sufficient 
conditions  for  stability: 
2 


(a  -  — )  <  0 
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2  ~  2  ^ 

Pc       ~       Pc  2  c 

8(a  -  ^)(a  -  ■^)  +  (x  +  ^  >  0 

r 


77 
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2 

2  (a  -  — )   [24  (a  -  — )     -  (x  +  3k- ^] 
r  r  ^  r 

"  2      „  4  6 

-  6  (a  -  — )   (x  +  k^)^  -  2k^(x  +  k^  )  (x  +  3k3  )  ^ 

_       ~  2  4 

-  4  (a  -  — )  k^  ^  <  0.  78 

r       4  2 
r 


Under  equilibrium  conditions,  the  sufficient  conditions  become 
Pc^ 

(a  -  — )  <  0  79 


Pc^  - 

8  (a  -  ■^)  a  >  0  80 
r 

o  2  .24 
Pc^  ''4 

12  (a  -  — )  <  -h: —  .  81 
r  /. 


Ihe  first  of  these  is  an  obvious  result.     Combining  the  first  and 
second  requires 

a  <  0  82 

which  requires,  from  equation  (70),  that  the  system  of  equation  (1 ) 

Pc^ 

be  stable.     Returning  to  equation   (75),  if  the  quantity    became 

negative  such  that  (a  -  >  0,     then  instability  would  occur.  Ihe 

last  of  these  inequalities  establishes  an  upper  limit  for  second 
moment,  P,  thus  precludes  an  arbitrarily  large  gain  to  improve  the 
filter  response. 
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In  obtaining  the  above  inequalities,  the  equilibrium  value  of  P, 

P     ,    was  chosen  as  its  positive  semi -definite  value  for  a  stable 
ss 

system.     Tiie  inequalities   (79)  through  (81  )  are  based  on  this  selection. 
The  first  of  these  inequalities  is  assured  for    P    positive  semi-definite 
as  was  the  case  for  the  linear  filter.     If,    P    is  positive  semi-definite, 
a  stable  filter  results. 

In  the  previous  developments,  stability  conditions  up  to  the 
fourth  quasimoment  were  determined.     Stability  conditions  for  the 
higher  moments,  however,  must  also  satisfy  the  conditions  for  the  lower 
ones  since  Sylvester's  criterion  adds  additional  equations  within  the 
determincint  which  adds  additional  inequalities  to  those  previously 
obtained . 

For  the  cases  of  low  and  high  couplings,  stability  is  assumed. 
With  this  assumption,  the  stationary  values  of  the  quasimoraents  will 
be  evaluated  to  add  further  evidence  as  to  the  degree  of  coupling  between 
the  filtering  equations  and  the  resulting  performance  improvements  of 
the  truncated  non-linear  filter  relative  to  the  linear  filter. 

The  assumption  of  a  Gaussian  jump  amplitude  distribution  will  be 
used  in  the  following.     This  assumption  permits  the  use  of  specific 
numbers  rather  than  proportionality  constants  in  obtaining  expressions 
for  the  stationary  quasimoments .     The  higher  moments  of  the  jump  ampli- 
tude distribution  are  related  by  powers  of  the  lower  moments ,  and  for 

2  3 

the  Gaussian  distribution  are  given  as  =  ^^2'    "5  ~  ^^^'2'     ^^-'^  • 

From  the  non-linear  filtering  equations,  the  following  expressions 
are  obtained  for  the  stationary  quasimoments : 
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1C3  =  0 


-  3/4\ct, 


■^4  = 


1  + 


2 
a  r 


83 


84 


k„  = 


2      /  ^"2'^ 
9/8  Xa^(^    1  — 

a  r 


-  1  ) 


85 


Xa  c 
ad   .  -|-) 
a  r 


15  ,  3 
6-^°'2 


r2_x(  ^  ) 


1  ] 


86 


a^/   1  + 


2~~ 
a  r 


1  + 


a  r 


The  expression  for  the  stationary  second  moment  is  given  by  equation 
(51  ). 

Ite -examination  of  Convergence  to  Linear  Filter 

Before  proceeding  with  evaluation  the  performance  of  the  non-linear 
filtering  equations,  the  case  of  high  jump  rate  and  low  jump  amplitude 
will  be  re-examined.     This  will  be  accomplished  using  the  stationary 
quasimoments  from  equation   (84  )  through   (86  ) . 

Case  I;     A.  -  =>,     gl^      0,  =  constant. 

From  these  equations,  the  term    XCI2     occurs  as    Xa"*     n  =  1,  2, 
3,    .   .        Then  as     X  -        and    a    —  0     while    Xa     =  constant, 
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Xo"      0    for    n  >  2    for  all  the  equations.    Iherefore,  the  stationary 
quasimoraents  tend  to  zero    with  the  hiqher  moments  approaching  zero 
more  rapidly  in  the  limit  than  the  lower  ones.    For  a  more  general  jump 
amplitude  distribution  than  Gaussian,  the  same  result  holds  as  long  as 
"2  (£  +1  )      °' 22  ra  >  n    and    £  =  1,2,  .... 


Non-linear  Filter  Performance  -  Low  Signal -to-Noise 

Again,  using  the  stationary  quasimoments ,  the  performance  of  the 

non-linear  filtering  equations  are  examined  for  the  case  of 

,  2 
Xot  c 

—  «1. 

Xa  c 

Case  II:  — - —  «  1  . 
a  r 

Ihe  stationary  quasimoments  become 

^  I       P  -  0  87 

,  2 
9    ^"2"  -  > 

a  r 

i-        15   ,9    ^^^2^    ,^"2=^      ^"2^  /"2=\n 

'^6  ^  -  ^32  ("T-^  -  ("T-^^  -  °  «^ 

a  r  c  a  r 

where  the  stationary  second  moment  was  found  earlier.     From  equation 
(58),  this  moment  is 
Xa„ 


2a  58 


which  is  the  process  noise  variance. 
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This  case  is  the  case  considered  by  Au    (1979).    As    X  -  0,  the 

stationary  quasimoments  tend  to  zero.     Other  limits  of  the  system 

parameters  can  also  yield  the  same  results,  therefore,  making  this 

single  parameter  effect  nonunique.  2 

Xa^c 

From  equation  (88),  it  is  seen  that  for  — - — ^  0    but    P  finite, 

a  r 

the  stationary  quasimoment  tends  to  zero.     This  is  the  second  "break" 

of  the  couplings  between  the  non-linear  equations,  the  first  being 

2 

Xoi^c 

k  .     Therefore,  when  — ^  •  0,  the  non-linear  filtering  equations 

a  r 

uncouple  and  the  filtering  performance  offers  little  improvement  over 
the  linear  filter  which  is  no  better  than  the  process  noise. 

To  illustrate  this  further,  from  the  equation  in  Table  1,  the 
k/ 

coupling  occurs  as  — — .     Then  these  terms  become 

,-2  ,2 
k  c  Xa  c 

—  ^(— ^)a„  90 

r         4    ar  2 

-    2  2  2 

k  c  Xa  c      Xot  c 

—  7^(^— )  (-^— )a„  91 

r         16      2         ar  2 
a  r 

,  etc . 

2 

Xa^c 

Therefore,  if   '  0,   then  the  stationary  quasimoments  tend  to  zero. 

Again,  under  these  conditions,  the  non-linear  filtering  equations 

become  uncoupled  as  indicated  by  the  values  of  the  stationary  quasimoments. 

In  summary,  for  this  case,  the  non-linear  filtering  equations  yield 
stable  results;  however,  the  performance  offers  little  improvement  over 
the  linear  filter  which  is  no  better  than  the  process  noise. 
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Non -linear  Filter  Performance  -  High  Signal -to-Ntaise 

Finally,  the  conditions  in  which  the  non-linear  filtering  equations 
offer  a  performance  improvement  are  examined.     This  improvement  is 
accompanied  by  a  potential  reduction  of  the  filter's  stability  charac- 
teristics, however,  for  the  following  discussions,  it  is  assximed  that 
the  conditions  previously  established  for  stability  are  satisfied. 


,  2 
Xa  c 

Case  III:  — - —  »  1 
a  r 


For  this  case,  the  stationary  quasimoments  are 


4      4  c  \/  2 


^  v       /  Xa^r  92 


5      8  c  \/  2 


K  -  I  --^  /  Xa^r  93 


Or,  as  before,  the  following  coupling  relationships  are  obtained: 


•^4^'       3        /  ^"2 

—  -4  W   —  ^5 


96 


etc- 


For  this  case,  the  stationary  second  moment  is  given  by 
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Also,  the  coupling  term  is  given  by 


98 


From  equations   (92)  through  (96),  it  is  seen,  based  on  the  magnitudes 

of  the  stationary  quasimoments ,  that  if  the  quantity  c 
is  large,  strong  couplings  exist. 


Summary 

In  this  section,  the  stability  and  performance  of  the  non-linear 
filtering  equations  have  been  addressed  for  filters  truncated  at  differ- 
ent moments  of  the  infinite  dimensional  non-linear  filtering  equations. 
It  was  shown  that  the  linear  filter,  a  truncation  at  the  second  moment, 
exhibits  stable  performance  with  improved  convergence  for  systems 
possessing  high  signal-to-noise  ratios,  and  stable  but  poor  performance 
improvement  over  the  process  noise  for  systems  possessing  low  signal- 
to-noise.     For  the  non-linear  filtering  equations,  it  was  demonstrated 

that  for  low  signal-to-noise  the  non-linear  filtering  equations  became 

2 

uncoupled  when  — ^ —  «  1  .     Ihis  condition  results  in  little  improve- 
a  r 

ment  of  the  non-linear  filtering  equations  over  that  provided  by  the 
linear  filter. 

For  the  truncated  non-linear  filtering  equations  with  high 

2 

signal-to-noise  and  when  — - —  »  1  ,     it  was  demonstrated  that  strong 

a  r 

couplings  exist  between  the  equations.     Ihe  potential  for  improvement 
offered  by  the  non-linear  filtering  equations  is  accompanied  by  the 
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likelihood  of  instability.    Conditions  were  established,  using  Lyapunov 
techniques,  to  assure  stability  of  the  truncated  non-linear  filtering 
equations • 

In  the  next  section,  niimerical  examples  will  be  presented  for 
the  cases  of  high  and  low  signal-to-noise  and  with  and  without  the 
lower  bound  condition  for  stability  of  the  truncated  non-linear  filter 
imposed . 


CHAPTER  FOUR 
NUMERICAL  EVALUATION 

Introduction 

The  purpose  of  this  chapter  is  to  evaluate  the  conditions  estab- 
lished in  the  previous  chapter  using  specific  numerical  examples.  TVo 
of  these  numerical  examples  are  those  reported  previously  by  Eckberg 
(1970)  and  Kvakernaak  (1975)  and  two  additional  examples  supplement 
the  range  of  variation    of  the  signal-to-noise  ratio  to  agree  with 
the  magnitude  variations  of  this  quantity  used  earlier.     These  examples 
will  be  simulated  using  filters  truncated  at  the  second  moment,  fourth 
quasimoment  and  sixth  quasimoment . 

In  addition  to  the  previous  attempts  of  Eckberg  and  K«7akernaak 
of  simulating  the  filtering  equations,  others  have  been  reported  by 
Clements  and  Anderson  (1973).     In  this  reference,  the  non-linear 
filtering  equations  of  Wonham  (1955)  for  the  random  telegraph  wave  were 
simulated.     Reported  in  this  reference  and  in  Eckberg  and  Kwakernaak 
were  stability  problems  with  the  numerical  simulations. 

For  a  non-linear  system  driven  by  a  continuous  Wiener  process, 
Astrom  (1955)  used  numerical  simulation  to  obtain  the  steady -state 
probability  density  distributions  for  several  numerical  examples. 
Unlike  the  other  reports,  Astrom  did  not  report  problems  with  numerical 
stability.     Ihe  numerical  algorithm  used  to  simulate  the  filtering 
equations  and  the  process  defined  by  equations  (1  )  and   (3)  is  similar 
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to  that  used  by  Astrom;  however,  as  in  the  previous  similar  simulation 
attenpts,  stability  problems  were  encountered. 


Numerical  Algorithms 
Approximations,  for  implementation  onto  a  digital  computer,  were 
used  to  simulate  the  process  described  by  equations  (1  )  and  (3). 
These  stochastic  differential  equations  can  be  interpreted  as  the  limit 
of  the  following  stochastic  difference  equations  : 


x^^(t    ,  )  =  x^^(t  )  +  ax^^(t  )At  +  a(t   )6  99 
At    n+1  At    n  At    n  n  nm 


dy^^  =  c  x.^(t     ,  )  At  +  v(t   )  Jht 
At  At    n+1  n  V 
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where    6        is  the  Kronecker  delta  function  defined  by 
nm  ^ 


n  =  m 

nm  ^ 

0        n  ^  m 

where  the  subscripts    n    and    m    denote  the  n      time  step  separated 
by  time  step    At    and  the  m      time  step  at  which  a  jump  should  occur. 
The  filtering  equations  in  Table  1  were  simulated  in  a  similar  fashion. 
Ihe  filtering  equations  were  implemented  as  the  stochastic  difference 
equation 

2i^^nxi  )  =  x(t^  )  +  f  (x,  t„  )At  +  qAt  +  -(dy.^  -  cx(t   )At)g(x,  t  ) 
—   n+1        —    n  n  —         r      At       —   n  —  n 

102 

where    x    is  the  vector  composed  of  the  moments  included  in  the 
truncated  filter  equations. 


M4 


"Hie  process      v(t  )    is  generated  using  the  system  routine  for 


n 


developing  psuedo  random  numbers  uniformly  distributed  within  the 
interval   (0,  1  ).     J^proximate  normally  distributed  random  numbers 
were  generated  by  summing  twelve  uniformly  distributed  pseudo  random 
numbers.     This  result,  minus  the  mean  and  multiplied  by  the  sguare 
root  of  the  apriori  variance,  yielded  the  sequence  v(t^). 

From  Astrom  it  was  demonstrated  that  the  solution  of  difference 
equations  that  approximate  stochastic  differential  equations  such  as 
equation  (102)  will  converge  (in  the  sense  of  mean  square)  to  the 
solution  of  the  stochastic  differential  equations.  Also  the  distri- 
bution law  of  the  sequence  of  the  difference  equations  will  converge 
to  the  distribution  laws  of  the  process  of  the  differential  equation. 


For  each  of  the  numerical  examples,  three  filters  all  operating 
on  the  sample  path  generated  by  the  system  of  equations   (1 )  and  (3) 
will  be  evaluated  continuously  over  an  interval  of  the  reciprocal  of 
the  jump  rate    X.     The  three  filters  are    1  )    linear  filter  (truncated 
at  the  second  moment),     2)    non-linear  filter  truncated  at  the  fourth 
quasimoment,  and     3)    non-linear  filter  truncated  at  the  sixth 
quasimoment . 

The  measure  of  performance  for  the  filters  is  the  mean  square 
error.     For  the  i^*^  time  step  and  the  j*"^  filter,  this  error  is  computed 
recursively  by 


Basis  of  Evaluation 


M 


se . 


i+1  ,  j 


=  M 


se . 


1.  D 


[(x.   -  X.    .)^  -  M 
1         1 ,  D  : 


se . 
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This  recursive  equation  for  the  mean  and  another  presented  later  for 
the  variance  eliminates  the  necessity  for  storing  the  results  for  later 
"batch"  processing  to  obtain  the  statistical  data.     The  mean  square 
error  continuously  computed  over  the  time  interval  permits  the  corre- 
lation between  the  filter  performance  and  those  variables  that 
influence  the  performance,  i.e.,  P. 

Also  presented  for  each  of  the  filters  and  the  numerical  examples 
is  the  continuously  computed  mean  of  the  second  moment  and  its  variance. 
The  recursive  equations  used  to  calculate  the  mean  and  variance  for 
the  i^'^  time  and  j^*^  filter  are  given  by 

M_  =  M„        +  ^  (P.    .    -  )  104 

P.,.        P..i+1i,i  P.. 
1+1, J  i,J  i,J 


4  =  Op       +Ic4y(p.    .     -  Mp      )^  -  Op      ]  105 

P.,.        P..      11+1     1,1  P..  P.. 

1+1, J         i,J  i,J  i,J 


The  filter  stability  and  convergence  are  influenced  by  the  instantaneous 
value  of  P. 

The  filter  performances  are  presented  for  a  time  interval  of  the 
inverse  of  the  jump  rate    X.     During  this  interval,  the  probability 
that  no  more  than  one  event  occurring  is  0.736.     If  an  interval  twice 
as  long  were  used, then  this  probability  would  drop  to  0.405-  Corres- 
ponding to  the  assumed  Gaussian  distributed  jump  amplitudes,  for  each 
of  the  numerical  examples,  two  amplitudes  were  examined,  one  and  two 
Sigma  values  of  the  amplitude  standard  deviation. 

The  computer  simulation  runs  were  started  with  all  variables,  mean, 
second  and  quasimoments ,  equal  to  zero.    One  hundred  points  were 


H6 

generated  and  processed  by  the  filters  before  the  jump  in  equation 
(99)  occurred. 

Discussion  of  Results 

Results  from  the  simulations  for  the  numerical  examples  are  pre- 
sented to  show  the  relative  performances  of  the  filtering  equations 
developed  earlier.     The  unconstrained  performance  of  the  fourth  and 
sixth  quasimoment  filtering  equations  will  be  presented.     They  illus- 
trate the  potential  for  improvement  for  high  amplitude  jumps  and  the 
potential  for  momentary  instability  and  associated  poor  performance 
for  low  amplitude  jumps.     Two  of  these  numerical  examples  will  be  used 
to  demonstrate  the  improvement  in  performance  for  both  the  fourth  and 
sixth  quasimoment  filtering  equations  when  the  second  moment  is  con- 
strained to  be  positive  semi-definite. 

This  constraint  is  implemented  within  the  computer  simulation 
programs  as  a  simple  test  to  determine  if  the  current  value  of  the 
second  moment  would  become  less  than  zero  if  the  incremental  value  of 
the  second  moment,  determined  by  equation  (102),  were  added  to  it. 
If  this  second  moment  were  to  become  less  than  zero,  then  the  increment 
is  not  added  and  the  second  moment  retained  its  value.     This  process 
continues  each  time  step  until  the  simple  test  results  in  a  positive 
semi-definite  second  moment.     This  process  is  a  suboptimal  procedure; 
however,   it  yields  improved  performance  in  the  simulation  results  to  be 
seen  later. 

The  system  parameter  values  assumed  for  the  numerical  examples 
and  other  combinations  of  those  values  are  presented  in  Table  3. 
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The  first  two  examples  are  from  the  other  published  simulation  studies. 
The  last  two  were  added  to  increase  the  range  of  signal-to-noise  con- 
ditions.    The  Kwakernaak  example  and  the  third  example  will  be  used 
for  comparison  vrtien  the  constrained  value  for  the  second  moment  is 
used . 

Unconstrained  Second  Moment  Comparisons 

It  is  seen  from  the  figures  for  the  mean  squared  error,  the  benefit 
of  the  non-linear  filtering  equations  over  the  linear  filter  is  the 
increased  response  of  the  estimate  of  the  state  value  to  the  state. 
The  curves  illustrating  the  mean  of  the  second  moment  reflect  the  higher 
initial  weighting  of  the  measurements  as  compared  to  the  linear  filter 
second  moment.     Through  examination  of  the  variance  about  the  mean  of  the 
second  moment,  when  this  quantity  is  large  relative  to  the  mean,  it  is 
seen  that  the  non-linear  filter's  performance  is  poor.     These  trends 
are  consistent  for  all  the  examples  with  high  signal-to-noise  using 
unconstrained  second  moments  in  the  filtering  equations.     For  the 
example  for  low  signal-to-noise,  there  is  little  difference  between 
the  filters'  performance  with  sluggish  responses  for  all. 

The  perf omances  of  the  linear  filter  and  the  fourth  quasimoment 
filter  are  comparable  for  jump  amplitude  at  the  one  sigma  level,  while 
the  sixth  quasimoment  filter  exhibits  relatively  poor  performance. 
For  jump  amplitudes  of  the  two  sigma  level,  the  sixth  quasimoment 
filter's  performance  is  better  than  the  fourth  quasimoment  filter 
which  is  better  than  the  linear  filter.     For  the  high  signal-to-noise 
examples ,  the  fourth  quasimoment  filter  exhibits  the  best  overall 
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FIGURE  2.    Eckberg  example,  Unconstrained,  One  sigma  jump  mean 
of  second  moment  for  non-linear  filters 
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FIGURE  3. 


Eckberg  example,  Unconstrained,  One  Sigma 
jump  mean  squared  error  for  all  filters 
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FIGURE  6.    Eckberg  example,  Unconstrained,  Two  sigma  jump  mean 
squared  error  for  all  filters 
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FIGURE  7.    Eckberg  example,  Unconstrained,  Two  sigma  jump  mean 
of  second  moment  for  non-linear  filters 


I 

56 


FIGURE  8.    Eckberg  example,  Unconstrained,  Two  sigma  jump 
variance  of  second  moment  for  non-linear  filters 
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FIGURE  9.     Kwakernaak  example,  Unconstrained,  One  sigma  jump 
linear,  4th  and  6th  quasimoment  filter  vs  state 


FIGURE  10.     Kwakernaak  example,  Unconstrained,  One  sigma  jump 
mean  squared  error  for  all  filters 


59 


60 


61 


4.0 


3.0  • 


2.0  ■ 


1.0  ■ 


0      0.2   0.4   0.6   0.8  1.0 

( sec ) 

(a) 


4.0  , 


3.0 


2.0 


1  .0 


0      0.2   0.4   0.6   0.8  1.0 

( sec ) 

(b) 


4.0 


3.0  ■ 


2.0 


1  .0 


0      0.2   0.4    0.6    0.8  1.0 

(sec) 

(c) 

FIGURE  13.     Kwakernaak  example,  Unconstrained,  Two  sigma  jump 
linear,  4th  and  6th  quasimoment  filter  vs  state 
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FIGURE  14. 


Kwakernaak  example,  Unconstrained,  Two  sigma  jump 
mean  squared  error  for  all  filters 
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Example  3,  Unconstrained,  One  sigma  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 
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FIGURE  18.    Example  3,  Unconstrained,  One  sigma  jump  mean 
squared  error  all  filters 
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FIGURE  21.    Example  3,  Unconstrained,  Two  sigma  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 


FIGURE  22.    Example  3,  Unconstrained,  Two  sigma  Jump  mean 
squared  error  for  all  filters 
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Example  4,  Unconstrained,  One  sigma  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 
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FIGURE  26.    Example  4,  Unconstrained,  One  sigma  jump  mean 
squared  error  for  all  filters 
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FIGURE  29.    Example  4,  Unconstrained,  Two  sigma  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 
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FIGURE  30.    Example  4,  Unconstrained,  Two  sigma  jump  mean 
squared  error  for  all  filters 
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performance.    This  is  apparently  the  result  of  its  increased  response 
over  the  linear  filter  and  its  apparent  better  stability  than  the 
sixth  quasimoment  filter. 

In  the  fourth  quasimoment  filter,  for  all  the  high  signal-to- 
noise  examples,  the  mean  of  the  second  moment  increases  with  increasing 
jump  amplitudes.     The  variance  of  the  second  moment  about  the  mean  does 
not  change  significantly  with  jump  amplitude  and  maintains  a  fairly 
constant  value  after  the  initial  response.     The  mean  of  the  second 
moment  converges  to  the  value  of  the  stationary  linear  filter  error 
variance  as  computed  by  equation  (51). 

The  sixth  quasimoment  filter  demonstrates  erratic  behavior  for 
jump  amplitudes  at  the  one  sigma  level.     This  behavior  is  consistent 
with  a  non-increasing  mean  of  the  second  moment  in  the  initial  response 
and  a  large  variance  of  the  second  moment  about  its  mean  value  relative 
to  the  mean.     The  situation  changes  with  jump  amplitudes  at  the  two 
Sigma  level.     The  variance  of  the  second  moment  is  relatively  smaller 
and  exhibits  a  more  uniform  increase  of  the  mean  of  the  second  moment 
to  a  lower  value  than  the  one  sigma  cases.     This  filter  demonstrates 
better  performance  for  larger  jump  amplitudes    and  has  poorer  per- 
formance relative  to  the  linear  and  fourth  quasimoment  filters  for 
lower  jump  amplitudes. 

In  summary  for  the  unconstrained  second  moment  in  the  filtering 
equations,  the  improved  performance  potential  of  non-linear  filtering 
equations  exists  with  systems  characterized  by  high  signal-to-noise. 
With  high  signal-to-noise,  the  fourth  quasimoment  filter  exhibits 
improved  performance  relative  to  the  linear  filter.     The  sixth 
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quasimoment  filtering  equation  exhibits  a  higher  degree  of  momentary 
instability  at  low  values  of  jump  amplitudes  than  the  fourth  quasi- 
moment filter  with  associated  degraded  performance.     At  this  point, 
the  fourth  quasimoment  filtering  equations  yield  the  best  performance. 

Constrained  Second  Moment  Comparisons 

For  the  Kwakernaak  example  and  the  third  example,  the  following 
figures  illustrate  the  results  of  the  simulations  when  the  second 
moment  is  constrained  to  be  positive  semi-definite  by  the  suboptimal 
process  described  earlier.     It  is  seen  that  the  mean  squared  error 
for  the  fourth  quasimoment  filters  is  very  similar  to  the  unconstrained 
cases  presented  earlier,  however,  with  a  slightly  improved  result.  The 
mean  squared  error  for  the  sixth  quasimoment  filtering  equations  exhibits 
a  dramatically  improved  result  for  the  one  sigma  jump  amplitudes  with 
the  results  from  the  two  sigma  jumps  also  improved. 

The  variance  of  the  second  about  its  mean  is  similarly  dramatic- 
ally reduced  for  the  sixth  quasimoment  filtering  equations.  The 
variance  of  the  second  moment  about  its  mean  for  the  fourth  quasi- 
moment filters  is  only  slightly  improved. 

The  results  from  implementing  the  constraint  that  the  second 
moment  remain  positive  semi-definite  yield  improved  filtering  per- 
formance recompared  to  the  unconstrained  situation. 

Summary  of  Unconstrained  and  Constrained  Examples 

Presented  in  Table  4  are  the  values  of  the  mean  squared  error 
for  the  linear,  fourth  quasimoment  and  sixth  quasimoment  filters  for 
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FIGURE  33.     Kwakernaak  example,  Constrained,  One  sigma  jump 
linear,  4th  and  6th  quasimoment  filter  vs.  state 
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FIGURE  3H.     Kwakernaak  example,  Constrained,  One  sigma  jump 
mean  squared  error  for  all  filters 
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FIGURE  37.    Example  3,  Constrained,  One  sigma  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 


FIGURE  38.    Example  3,  Constrained,  One  sigma  jump  mean 
square  error  for  all  filters 
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FIGURE  41.    Example  3,  Constrained,  Two  sigtna  jump  linear, 
4th  and  6th  quasimoment  filter  vs  state 


FIGURE  H2.    Example  3,  Constrained,  Two  sigma  jump  mean 
squared  error  for  all  filters 
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the  Kwakernaak  and  third  examples  for  both  the  unconstrained  and 
constrained  second  moment  situations.     Tliiese  results  are  at  the  time 
corresponding  to  the  inverse  of  the  impulse  occurrence  rate  and 
quantify  the  degree  of  improvement  with  numbers  rather  than  visuali- 
zation from  the  figures. 

It  is  seen  that  improvements  in  the  simulation  results  are 
obtained  when  the  suboptimal  constraint  is  used  in  all  the  filtering 
equations . 

■nie  single  pulse  technique  of  evaluating  the  filter's  performance 
presented  thus  far  is  not  truly  reflective  of  a  compound  Poisson  pro- 
cess driving  noise.     That  is,  the  jumps  were  not  randomly  occurring 
in  time  or  at  random  amplitudes.     However,  the  single  pulse  technique 
does  provide  a  means  of  evaluating  the  relative  performance  of  the 
filters  examined,     lb  confirm  the  observations  from  the  single  pulse 
results ,  the  I^akernaak  numerical  example  is  used  in  simulations  where 
the  jumps  are  allowed  to  occur  randomly  in  time  and  with  random  ampli- 
tudes.    Ihe  algorithm  described  in  Snyder  (1975)  is  used  in  generating 
the  Poisson  process  time  dependency. 

Shown  in  the  figures  are  the  results  of  the  linear  and  fourth 
quasimoment  filters  using  three  values  of  the  "seed"  for  the  random 
number  generator.     Ihe  second  moment  for  the  fourth  quasimoment  filter 
is  constrained  to  be  positive  semi-definite.     These  results  for 
multiple  pulse  occurrances  again  demonstrates  that  the  fourth  quasi- 
moment filter  exhibits  better  performance  than  the  linear  filter. 
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Sximmary 

In  this  chapter,  simulation  algorithms  and  data  evaluation 
techniques  were  established  for  comparing  the    performance  results 
for  computer  implementations  of  the  filtering  equations  presented  in 
Chapter  Two.     Based  on  the  stability  constraint  developed  in  Chapter 
Three  and  implemented  in  a  suboptimal  technique,  improved  performance 
in  the  simulated  results  was  demonstrated  relative  to  the  uncon- 
strained situation.     It  was  demonstrated,  from  several  numerical 
examples,  that  improved  performance  over  the  linear  filter  is  obtain- 
able with  the  non-linear  filtering  equations  when  the  constraint 
that  the  second  moment  be  positive  semi-definite  was  invoked.  The 
fourth  quasimoment  filtering  equations,  with  the  stability  constraint 
exhibit  the  best  performance,  which  from  an  implementation  considera- 
tion is  a  potential  constrain  itself. 


CHAPTER  FIVE 
UNSTABLE  SYSTEM  FILTERING 

Introduction 

Hie  analysis  of  the  performance  of  the  truncated  filtering  equations 
presented  in  the  previous  chapters  considered  only  stable  systens.  It 
was  this  type  system  examined  in  the  previously  published  works  of 
Eckberg   (1970)  and  Kwakernaak   (1975).     Ihe  intended  application  of  this 
work  is  the  aerospace  application  for  tracking  maneuvering  targets  re- 
ferred to  in  Chapter  One.     For  this  problem  the  system  can  be  considered 
as  neutrally  stable  for  finite  times,     lhat  is,  the  system  matrix,  for 
the  multidimensional  system,  has  some  zeros  for  eigenvalues.     In  this 
case,  the  process  noise  or  "signal"  would  be  bounded  only  for  finite 
times.     To  address  the  neutrally  stable  problem,  the  scalar  unstable 
system  will  be  examined  as  the  more  severe  problem  for  the  performance 
of  the  truncated  filtering  equations. 

The  performance  of  the  truncated  filtering  equations  when  the  syston 
given  by  equation  (1  )  is  unstable,     a  >  0,  will  be  examined  in  the 
following.     First,  as  in  the  previous  chapters,  the  stability  of  these 
equations  will  be  examined  using  Krasovskii's  Theorem.     Hie  results 
will  again  establish  sufficient  conditions  for  the  truncated  filtering 
equations  about  an  equilibrium  point.     It  will  be  shown  that  a  condition 
for  stability  is  that  the  second  moment  be  positive  definite. 


104 


105 

Given  this  condition,  numerical  examples  will  be  presented  demon- 
strating the  truncated  filters'  performance.     For  this  demonstration, 
the  numerical  examples  of  Kwakernaak  and  Example  3  before  will  be  used 
with  the  sign  of   "a"  reversed.     Ihis  will  illustrate  two  levels  of 
"instability."    Only  the  truncated  linear  and  fourth  guasimoment 
filtering  eguations  will  be  used  for  this  demonstration.     It  will  be 
shown  that  with  the  developed  constraint  that  the  fourth  guasimoment 
filter  exhibits  improved  perfonnance  over  the  linear  filter- 

Truncated  Filtering  Equation  Stability  and  Perf ormance-Lfristable  Systems 
For  the  case  of  an  unstable  system,  the  state  estimate,    x,  is  not 
an  eguilibrium  point  to  satisfy  the  Lyapunov  function  reguirements .  If 
the  system  is  unstable,     x    and    x    will  both  become  unbounded  since 
there  is  a  non-zero  probability  that  the  time  interval  between  jiomps 
will  be  sufficiently  long  to  effectively  make  the  system  unbounded. 
However,  the  estimate  error  should  remain  bounded  and  satisfy  the 
reguirements  for  the  eguilibrium  condition.     Therefore,  the  truncated 
filtering  eguations  will  be  transformed  into  a  system  of  eguations  for 
the  estimate  error  and  higher  moments  coupled  by  this  error  rather  thein 
by  the  state  estimate. 

refining  the  estimate  error,     e,  as 

e  =  X  -  X,  106 

the  differential  error  becomes 
Pc 

de  =  aedt  +  — (dv  -  cedt)  -  do.  107 


106 


Proceeding  as  before,  the  unforced  equations,  written  in  terms  of  the 
estimate  error,  are 

Pc^ 

e  =  (a  -  — )e  108 
r 

2  2  k  c^ 

P  =  2aP  -  +         -  — —  e  109 

r  2  r 

,    r,  2  ,2 
k  Pc        k  c 

k,  =  3ak,  -  3  —         -  — —  e.  110 

3  3  r  r 


The  stability  of  these  equations  about  an  equilibrium  point  are  to  be 
evaluated.     To  satisfy  the  requirement  for  the  equilibrium  point  for  the 
Lyapunov  function,     f.(0_)  =  0^    and    2i  =  £.    is  the  equilibrium  point, 
these  equations  must  be  transformed  as  before.     For  the  unstable  system, 
the  positive  definite  steady  state  value  of  the  second  moment  is  given 
by 


JXct  c^ 
1   +—    1.  Ill 
c  a  r 


The  resulting  transformed  unforced  equations  become 
Pc^ 

e  =  (a  -  112 
r 

~2  2  k.c^ 
~       „_~       P  c  3 

P  =  2aP  e  113 

r  r 

2 

r^2  k^C 

k    =  3  (a  -  — -)  k_  e  114 

3  r        3  r 

where    a    is  given  in  equation  (70).     Cbntinuing  with  the  Lyapunov 
function  construction  technique  given  by  Krasovskii ■ s  Iheorem  and  the 
evaluation  of  the  negative  definiteness  of  the  matrix    F(x)  using 
Sylvester's  criteria  yields  the  following  inequalities  as  sufficient 
conditions  for  stability 
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2  (a  -  — )  <  0  115 
r 


p  2  „  4 

8  (a  -  — )  -  (e  +  k,  )^  2_  >  0  116 
r  3  2 

r 

~  2  ~  2  4 

Pc  Po  2  c 

2  (a  -  —  )  [24  (a  -  — )  -  (e  +  3k^  r  ^] 
r  r  3  2 

r 

2  2-2  4 

+  (e  +  k_  )  —  [-6  (e  +  k_  )  —(a  -  — )  -  k^  (e  +  3k,  )  2-] 
3r  3r  r4  32 

r 

2  4  -22 

-  k .  — [  (e  +  k_  )  (e  +  3k. )  2_    +  4k  (g  _  £2_  )  £_  j  <  q .        1 1  7 
4r  3  32  4  rr 

r 


Cf ,  under  equilibrium  conditions ,  these  inequalities  are  equivalent  to 
the  following 

Pc2 

(a  -  — )  <  0  118 


p  2  2 

(a  -  -2-)    >  0  119 
Pc^  2      k  'c^ 

12(a  -  ^)     <  -^j-  .  120 


For  an  unstable  system,  the  first  of  these  inequalities  return  with  the 
initial  assumption  that  the  second  moment,     P,     be  positive  definite. 
The  second  of  these  is  always  true  and  the  third  requires  that    P  not 
be  arbitrarily  large.     Using  additional  quasimoment  equations  in  this 
stability  analysis  will  result  in  conditions  which  must  be  satisfied 
in  addition  to  those  already  determined  at  this  point. 
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Assuming  stability,  the  stationary  quasiraoments  will  be  examined 
under  limiting  conditions  as  before  to  establish  the  degree  of  coupling 
between  the  filtering  equations.    The  stationary  quasimoments  for  an 
unstable  system  are 


=  0  121 


3  ^  2 
-  4  ^"2 

k    =    122 


4 


a 


,  2 
Xa  c 

1  + 


2 
a  r 


9       2  /  ^"2*^^ 

k    =    -1 23 

Xa  c 
-ad  .-|-) 
a  r 


15  ,  3 


,  2 
Xa^c 


^ot-,  ^  2 


6        2  ..9 


1.^ 
a^r 


Comparing  these  equations  with  equations  (83),   (84)  and   (85),  it  can 
be  seen  that  the  results  of  limiting  arguments  such  as  those  used  pre- 
viously would  lead  to  similar  conclusions  about  the  significance  of  the 
signal-to-noise  ratio  since  the  equations,  except  for  sign  differences, 
are  similar.     Hiere  is  a  difference,  however,  in  that  the  process  noise 
signal  given  before  in  eqaution   (58)  does  not  have  a  corresponding 
constant  stationary  value  for  the  unstable  system  problem.     In  this  case 
the  process  noise  variance  grows  with  time. 
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Numerical  Evaluation 

The  numerical  evaluation  of  the  truncated  filtering  equations 
will  be  conducted  in  this  section  in  a  manner  similar  to  that  used  in 
Chapter  Four.    The  numerical  algorithm  presented  in  equation  (102)  will 
again  be  used  to  propagate  the  moment  equations  in  time.     The  recursive 
equations  (103  ),   (104)  and  (105)  will  again  be  used  to  provide  "running" 
mean  squared  error,  mean  of  the  second  mcxnent,  and  variance  of  the 
second  moment  respectively . 

First  the  single  pulse  evaluation  for  one  and  two  sigma  jump  levels 
will  be  presented  for  the  redefined  unstable  Kwakemaak  example  with 
the  constraint  of  positive  definiteness  of     P    imposed.     Then  for  the 
redefined  unstable  Kwakemaak  and  Example  3  examples,  a  multipulse 
evaluation  will  be  presented  in  which  the  occurrence  and  amplitude  of 
the  jumps  are  governed  by  their  randcm  occurrence  and  amplitude 
behavior . 

From  the  figures  for  the  single  pulse  responses  at  both  jump  levels 
it  is  seen  that  the  fourth  quasimoment  filter  exhibits  much  more  signifi 
cantly  improved  performance  over  the  linear  filter,  in  terms  of  lower 
mean  squared  error,  for  the  unstable  problem  than  for  the  stable  problem 
It  is  seen  also  that  the  mean  of  the  second  moment  converges  to  the 
stationary  value  for  the  unstable  system  problem  as  it  did  for  the 
stable  problem.     This  is  consistent  with  the  stationary  thiird  quasi- 
moment being  zero. 

The  multipulse  performance  results  also  reflect  improved  perform- 
ance of  the  fourth  quasimoment  filter  over  that  of  the  linear  filter. 
For  both  the  redefined  Kwakemaak  and  Example  3  examples,  the  fourth 
quasimoment  filter  exhibits  lower  mean  squared  error  than  the  linear 
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filter  after  jumps  start  occurring.     Prior  to  the  first  jump,  both 
filters'  mean  squared  error  are  lower  than  that  expected  and  compared 
to  the  stationary  second  moment  value.     Shortly  after  the  first  jump 
occxirs,  the  mean  squared  error  for  the  fourth  quasimoment  filter 
becomes  less  than  that  of  the  linear  filter. 

As  seen  from  the  figures  of  the  multipulse  evaluations,  a  diver- 
gence occurs  at  some  point  in  the  sample  path.     These  divergences  are 
the  result  of  numerical  imprecisions  from  taking  differences  between 
large  numbers.    This  divergence  occurs  earlier  for  the  redefined  Kwakernaak 
example  than  for  the  redefined  Example  3  since  the  redefined  Kwakernaak 
example  is  more  "unstable"  than  the  redefined  Example  3. 

Summary 

In  this  chapter  the  performance  of  the  truncated  filtering 
equations  for  an  unstable  system  was  evaluated.     An  unstable  system 
possesses  a  growing  process  noise  or  signal  variance  as  does  a 
neutrally  stable  system  in  which  the  potential  application  for  this 
type  of  filtering  is  intended. 

It  was  shown  that  a  condition  for  the  stability  of  the  truncated 
filtering  equations  for  an  unstable  system  is  that  the  second  moment 
be  positive  definite.     The  associated  stationary  quasimoments  were 
seen  to  be  similar  except  for  signs  to  those  for  the  stable  problem, 
and  that  subsequent  limiting  arguments  as  to  the  significance  of  the 
signal-to-noise  ratio  would  also  produce  similar  results. 
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The  redefined  niiraerical  examples  were  used  to  demonstrate  the 
relative  performances  of  the  truncated  filtering  equations  for  the 
unstable  system  problan.     It  was  demonstrated  by  single  pulse  and 
multipulse  analyses  that  the  fourth  quasimoment  filter  exhibits  improved 
performance  over  that  of  the  linear  filter.     Additionally,  the  poten- 
tially unbounded  behavior  of  an  unstable  system  driven  by  compound 
Poisson  processes  was  demonstrated  by  these  numerical  examples.  For 
the  aerospace  application  of  maneuvering  target  tracking  by  a  converging 
missile  the  duration  of  the  problem  will  be  bounded,  thus  minimizing 
the  number  of  jumps,  and  potential  for  divergence. 


CHAPTER  SIX 
CONCLUSIONS  AND  RECOMMENDATIONS 


Summary  of  Conclusions 

In  this  dissertation,  optimal  filtering  equations,  using  quasi- 
moment  functions ,  for  systems  driven  by  compound  Poisson  processes 
have  been  derived.     These  equations  agree  with  those  obtained  by 
Fisher   (1967)  for  multivariable  systems. 

The  performance  of  sets  of  truncated  filtering  equations  was 
evaluated  in  terms  of  responsiveness  and  stability.     It  was  shown 
that  under  low  signal-to-noise  conditions  the  linear  filter  performs 
poorly  and  the  truncated  non-linear  filtering  equations  decouple  to 
become  linear  with  the  associated  poor  performance.     To  realize  the 
potential  improved  performance  obtainable  from  the  non-linear  filter- 
ing equations,  the  stability  of  these  was  examined.     It  was  shown 
that  if  the  system  described  by  equation   (1 )  is  stable,  then  the 
second  moment  must  be  positive  semi-definite  and,  for  an  unstable 
system,  the  second  moment  must  be  positive  definite. 

Numerical  evaluations  of  the  performance  of  these  truncated 
filtering  equations  was  conducted  using  examples  previously  published 
as  well  as  two  additional  examples.     These  examples  demonstrated 
the  potential  for  improved  performance  by  using  the  non-linear 
filtering  equations;  however,  the  stability  of  these  non-linear 
filtering  equations  must  be  assured  using  the  established  constraints 
in  order  to  realize  the  improvement  potential.     The  numerical  examples 
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also  demonstrate  the  importance  of  high  signal-to-noise  to  the  filter's 
performance. 

Recommendations  for  Further  Research 

The  problem  addressed  in  this  research  is  a  simple  time-invariant 
scalar  system,  a  single  state  variable  and  measurement.    The  potential 
application  will  require  filter  states  containing  three  or  four  state 
elements,  and  also  be  time-varying.     This  research  should  be  extended 
to  evaluate  the  improvements  possible  for  multivariable  time-varying 
systems.    With  the  associated  increased  dimensionality  of  the  filtering 
equations,  and  with  the  constraints  of  implementing  these  equations 
within  a  microprocessor,  techniques  should  be  examined  to  propagate 
the  states  and  moments  more  efficiently.     This  may  require  linearizing 
the  filtering  equations  and  using  state  transition  matrix  techniques. 

A  comparison  between  the  approach  used  in  this  research  and  those 
of  Moose  (1975)  and  Willsky  and  Jones  (1976)  should  be  made  to  deter- 
mine the  relative  performances  of  the  different  approaches. 

Finally,  the  sensitivity  of  these  non-linear  filtering  equations 
to  imperfect  modeling  and  apriori  statistical  information  should  be 
examined.     The  question  of  whether  these  equations  exhibit  the  same 
sensitivities  as  does  the  linear  filter  needs  to  be  addressed.  Also, 
what  techniques  can  be  used  to  prevent  stability  and  divergence  problems 
are  exhibited  by  linear  filtering  equations  under  these  conditions. 


APPENDIX  A 

QUASI -HOME  NT  FUNCTIONS 
[Fisher  1967] 

In  engineering  applications  where  near-Gaussian  probability  density 
functions  are  involved,  a  good  approximation  to  such  density  functions 
which  contains  only  a  few  parameters  is  highly  desirable. 

Let    p(p,  t)     be  the  non-Gaussian  density  function  which  has  the 
same  mean  and  variance  as    p  (p,  t).     It  will  be  shown  in  this  appendix 
that  the  quasi-moment  functions  are  the  coefficients  in  the  expansion 
of  the  ratio 

,       ,      p(|J,  t) 

p(w  t)  =  ^—7^ — A.1 
p  (m,  t) 

in  a  series  of  Hermite  polynomials.     If    p(ii,  t)     is  a  Gaussian  density 
function,  then    pCy,  t)  =  1 ,     and  the  quasi-moment  functions  are  all 
zero . 

The  Hermite  polynomials  form  a  complete  set  of  eigenfunctions  with 
a  zero  mean  Gaussian  density  weighting  function  over  the  Euclidean 
space    -00  <  p  <  +  00.     Therefore,  the  ratio    p(u,  t)  ,     for  any  probability 
density  function,  whether  nearly  Gaussian  or 

_/J    4jp  ^(p  ,  t)  <  oo  A. 2 

Also,  any    p(p,  t)     satisfying  Equation  (A. 2)  can  be  approximated  to 
any  desired  degree  of  accuracy  in  the  integrable  square  error  sense  by 
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by  a  finite  number  of  terms  in  the  Hermite  polynomial  series.    In  most 
engineering  applications,  only  a  few  of  the  quasi-moment  functions  are 
required  to  give  the  desired  degree  of  accuracy,  and  one  can  assume  the 
remaining  higher-order  quasi-moment  functions  to  be  zero.     From  this 
brief  discussion,  one  can  see  that  quasi-moment  functions  should  be 
very  useful  in  engineering  applications,  particularly  when  Gaussian 
processes  and  slightly  nonlinear  systems  are  involved.    The  quasi- 
moment  functions  will  now  be  developed  in  some  detail. 

Let    (p(u,  t)     be  the  characteristic  function  for    p(p,  t)  i.e., 

(p(u,  t)  =  /"  dppCp,  t)e^"^  A. 3 

Similarly,  let 

^)  =  iZ  clup  (u,  t)e^"^  A. 4 

Denote  the  mean  and  variance  by    x(t)     and    P(t),  respectively.  Then, 

by  definition  of    p  (u,  t)     and    cp  (u,  t), 

g  g 


p  (p,  t)  =  exp{-KM  -  x(t)]  p  ^  (t)[u  -  x(t)]} 
®     '  [(2n)|P(t)|]^ 


A. 5 


and 


(p  (u,  t)  =  expCiu  x(t)  -  JuP(t)u]  A. 6 

Now,  define    k(u,  t)     to  be  the  ratio  of    (p(u,  t)     and    cp  (u,  t): 
k(u,  t)  ~. 

cpg(u,  t) 

=  (p(u,  t)  expC-iu  x(t)  +  ^u  P(t)u]  A. 7 
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Expand    k(u,  t)     in  Maclaurin  series: 

.2  p      i3  ^ 

k(u,  t)  =  1  +  i  K^(t)u^  +  ^  K^{t)u    +  —        (t)u^  +  .   .  . 

.n 

+  V     Z„  K  (t)u"  A. 8 

nl     n=4  n 


where 


K  (t)  =  LoLklu, 


n  .n  ^  n 

1  au 


u=0 


A. 9 


The  K's  are  the  quasi-moment  functions  with  the  subscript  denoting 
the  order. 

Note  that,  by  the  definition  of    x(t)     and  P(t), 


^ll^i^      ^  =  ix(t)  A. 10 

u  u=0 


and 


.?ViL-_t).         .  p(t)  ^  x2(t)  A. 11 

6u  u=0 


Therefore,  from  Equation  (A. 9)  with  equations  (A. 10)  and  (A. 11),  it 
is  seen  that 


K^(t)  =  0 


K^Ct)  =  0 


A. 12 


Therefore,  all  of  the  quasi-moment  functions  of  first  and  second  order 
are  zero.     The  mean  and  the  variance  effectively  replace  these  f  it  ctions. 
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With  these  definitions  the  characteristic  function    <p  (P ,  t)  can 
be  written  as  follows: 

(p(u,  t)  =  {exp[iu  x(t)  -  iu  P(t)u]}x{l  +         i74<(t)u"}  A. 13 

Therefore,  the  characteristic  function  can  be  expressed  easily  and 
directly  in  terms  of    x(t),     P(t)     and  the  quasi-moment  functions. 

The  probability  density    p(M,  t)     is  obtained  by  taking  the 
Fourier  transform  of    <p(u,  t): 


P(P,  t)  =  -(jpf  la.  t)e  A.U 

Similarly,     p  (y,  t)     is  the  Fourier  transform  of    (p  (u,  t): 
S  S 

Pg(M,  t)  =  C>        ^^P^-  ^^^^  -  ^(^^^  -  5"  P(t)u}  A. 15 

Substitution  of  Equation  (A.  13)  into  Equation  (A. 14)  and  utilizing 
Equation  (A.  15)  yields  the  interesting  result: 

p(n,  t)  =  p  (m,  t)  +    E.  -i-^  K  (t)   §   A. 16 

g  n=3      nl      n  g^n 

However,  the  Hermite  polynomials    ^^(p,  t)  corresponding  to  p~\t) 
are  defined  by  the  following  relations: 

H^(M,  t)  =  (-1)"  exp[^M  P(t)p]        "^P^-  ^Y"'^'^'^-  A. 17 

Consequently , 

9"  P  (P,  t) 

(_1)   ,  H  [p  -  x(t),   t]p  (p,  t)  A. 18 

Finally,  Equation  (A.  16)  may  be  rewritten  with  the  use  of  Equation 
(A. 18): 
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p(y,  t)  =  Pg(M,  t)  {1  +         ^p"  '^n^^^  "n^^  ~  "^^^^  '  ^"^^ 

From  Equation  (A.I)  it  is  seen  that  the  ratio    p(u,  t)     is  simply 
the  series  in  the  brackets  in  Equation  (A. 19).     This  verifies  the 
earlier  statement  that  the  quasi-moment  functions  are  the  coefficients 
in  the  expansion  of    p(n,  t)     in  a  series  of  Hermite  polynomials. 

The  Hermite  polynomials  can  be  determined  directly  from  Equation 
(A. 17)  rather  easily.    Therefore,  it  is  clear  from  Equation  (A. 19) 
that  the  probability  density  can  be  expressed  easily  and  directly  in 
terms  of    x(t),     P(t)     and  the  quasi-moment  functions. 


APPENDIX  B 


DIFFERENTATION  RULE  AND  FILTERING  THEOREM 
[Kwakernaak  1975] 


Let    Q  ,  t  >  t  ,     be  the  semi-martingale  defined  by 

dQ^.  =  F^dt  +  dM^,  t  >  t^,  B.I 

where    M    is  a  martingale  with  respect  to  a  growing  family  of  sigma 
fields  t  >  t^,     and  where    F    is  a  process  that  is  adapted  to  "7". 

Let,  furthermore,  the  process    Y  ,  t  >  t  ,     be  the  semi-martingale 
defined  by 


dY,    =  H.dt  +  dV,  ,  t  >  t  B  2 

u        t  t.  -  o 


where    H    is  another  process  that  is  adapted  to  V    is  Browni 


an 


motion  and  a  martingale  with  respect  to    jF,     such  that    E(dV    dV  )  = 

t  t 

R(t)dt  and  R(t)  >  0  for  t  >  t^.  Define  Y^,  t  >  t^,  as  the  growing 
family  of  sigma  fields  generated  by  the  process    Y,     and  let 

^E(QjY^). 

F,  ^E(FjY^). 

H,  ^E(HjY^), 


1  27 


1 
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Fundamental  Filtering  Theorem  for  White,  Gaussian  Observation  Noise 
The  process    Q  ,  t  >  t  ,  satisfies 

dQ^  =  F^dt  +  [Q^H^  -  Q^H^  +  S^]R"\t)[dY^  -  H^dt]  ,      t  >  t^.  B.4 

Here    S     =  E(S  |y  ),     while    S    =  tt"        ,  W>  is  the  continuous 

part  of  the  martingale    M.     If  and  are  two  continuous 

martingale  or  semi-martingales,     <M^ ,  is  a  stochastic  process, 

which  is  given  by    <M^  ,  ^^^>  =  i(<M^  +      ,        +  M^>  -  <M^  ,  M^>  -  <M^,  M^>)  , 
where    <N ,  N>    is  the  increasing  process  associated  with  the  continuous 
martingale  or  semi-martingale  N. 


Outline  of  Proof 

The  proof  consists  of  the  following  steps.     (a)     First  it  is  shown 

that  the  innovations  process    I,     defined  by  dl     =  dY    -  H  dt,  I  =0 

o 

is  a  martingale  with  respect  to    Y,  and,  moreover,  is  a  Brownian  motion 

with    d<I ,  I>^  =  R(t)dt.     (b)     The  second  step  is  to  prove  that  the 

process    M  ,  defined  by    dM    =  dQ^  -  F^dt,  =  0,  is  also  a  martingale 

o 

with  respect  to  Y. 

(c)     Next,  a  representation  theorem  is  invoked,  which  says  that  if 
M      is  a  martingale  with  respect  to    Y,  while    Y    is  generated  by  the 
semi -martingale 

Vs  .  I^,  B.5 

o 

« 

with    I    Brownian  motion,     M      may  be  written  as 
o  o 


1  29 

where    L    is  a  process  that  is  adapted  to    Y.    Rewriting  (B.6)  in 
differential  form  it  follows  that    dQ^  =  F^dt  +  l-^-dl^-     (d)     It  finally 
is  established  that    L    may  be  expressed  as  in  (B.M)  by  proving  and 
using  the  equality    E(d(Q^|Y^)  Y^)  =  E(d(Q^.  Y^|y^). 

In  step  (d)  of  the  proof,  use  is  made  of  the  differentiation  rule 
of  Doleans-Dade  and  Meyer  for  discontinuous  semi-martingales.  Since 
this  rule  will  be  used  repeatedly  in  the  paper,  it  is  restated  here. 
Let  be  discontinuous  semi-martingale,  and  let    9    be  a  twice 

dif ferentiable  function.     Then  the  process    Q    =  <p(X  )     is  also  a 
semi-martingale,  such  that 

dQ^  =  «Px(\.)dX^  -  it^x^\-)^<^''^V 

B.7 

o-  - 

Here    cp      is  the  gradient  of  the  function    cp ,  m        its  Jacobian,  while 

X  XX 

Q 

X      is  the  continuous  part  of    X,     and  the  summation  is  carried  out 
over  those  values  of    s    where    X    jumps.     This  differentiation  rule 
reduces  to  the  Ito  rule  when  the  process  is  continuous. 


APPENDIX  C 
COMPUTER  PROGRAM  LISTINGS 
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